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PREFACE 


This book is intended to be used primarily as a text for a first course in discrete-time control 
systems at either the senior undergraduate or first-year graduate level. Furthermore, the text is 
suitable for self-study by the practicing control engineer. 

This book is based on material taught at both Auburn University and North Carolina State 
University, and in intensive short courses taught in both the United States and Europe. The 
practicing engineers who attended these short courses have influenced both the content and the 
direction of this book, resulting in emphasis placed on the practical aspects of designing and 
implementing digital control systems. 

Chapter | presents a brief introduction and an outline of the text. Chapters 2-11 cover 
the analysis and design of discrete-time linear control systems. Some previous knowledge 
of continuous-time control systems is helpful in understanding this material. The mathemat- 
ics involved in the analysis and design of discrete-time control systems is the z-transform and 
vector-matrix difference equations; these topics are presented in Chapter 2. Chapter 3 is devoted 
to the very important topic of sampling signals and the mathematical model of the sampler and 
data hold. This model is basic to the remainder of the text. The implications and the limitations 
of this model are stressed. 

The next four chapters, 4—7, are devoted to the application of the mathematics of Chapter 2 
to the analysis of discrete-time systems, emphasis on digital control systems. Classical design 
techniques are covered in Chapter 8, with the frequency-response Bode technique emphasized. 
Modern design techniques are presented in Chapters 9-11. Chapter 12 summarizes some case 
studies in discrete-time control system design. Throughout these chapters, practical computer- 
aided analysis and design using MATLAB are stressed. 

In this fourth edition, several changes have been made. We 


Added additional MATLAB examples throughout the chapters. 

Added a new chapter on system identification (Chapter 11). 

Added new problems in many of the chapters. 

Renumbered the end-of-chapter problems to reflect their corresponding textbook sections. 
Added the MATLAB pidtool design technique in Chapter 8. 

Added two new case studies in Chapter 12. 

Removed four chapters (formerly Chapters 11-14) and two appendices (formerly 
Appendices V and VI) on digital filter implementation to reduce the overall page count, 
thus placing more emphasis on control design. 


Each end-of-chapter problem has been written to illustrate basic material in the chapter. 
Generally, short MATLAB programs are given with many of the textbook examples to illustrate 
the computer calculations of the results of the example. These programs are easily modified for 
the homework problems. 

To further assist instructors using this book, a set of PowerPoint slides and a manual con- 
taining problem solutions has been developed. The authors feel that the problems at the end of 
the chapters are an indispensable part of the text, and should be fully utilized by all who study 
this book. Requests for both the problem solutions and PowerPoint slides can be sent directly to 
the publisher. 
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Preface 


At Auburn University, three courses based on the controls portion of this text, Chapters 2-11, 
have been taught. Chapters 2—8 are covered in their entirety in a one-quarter four-credit-hour 
graduate course. Thus the material is also suitable for a three-semester-hour course and has been 
presented as such at North Carolina State University. These chapters have also been covered in 
twenty lecture hours of an undergraduate course, but with much of the material omitted. The 
topics not covered in this abbreviated presentation are state variables, the modified z-transform, 
nonsynchronous sampling, and closed-loop frequency response. A third course, which is a one- 
quarter three-credit course, requires one of the above courses as a prerequisite, and introduces the 
state variables of Chapter 2. Then the state-variable models of Chapter 4, and the modern design 
of Chapters 9-11, are covered in detail. In a recent offering at North Carolina State University, 
Chapters 2—11 were covered in a one-semester, three-credit-hour course using this new edition 
and the companion set of PowerPoint slides that are also available. 

Finally, we gratefully acknowledge the many colleagues, graduate and undergraduate stu- 
dents, and staff members of the Electrical Engineering Department at Auburn University who 
contributed to the development of the first three editions of this book. In particular, we wish to 
thank Professor J. David Irwin, Electrical Engineering Department Head at Auburn University, 
for his aid and encouragement during those years. We would also like to acknowledge our col- 
leagues and students in the Electrical and Computer Engineering Department at North Carolina 
State University for their contributions to and support for this fourth edition. 


Charles L. Phillips 
Auburn University 


H. Troy Nagle 
North Carolina State 
University 


Aranya Chakrabortty 
North Carolina State 
University 
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Introduction 


1.1 OVERVIEW 


This book is concerned with the analysis and design of closed-loop physical systems that contain 
digital computers. The computers are placed within the system to modify the dynamics of the 
closed-loop system such that a more satisfactory system response is obtained. 

A closed-loop system is one in which certain system forcing functions (inputs) are deter- 
mined, at least in part, by the response (outputs) of the system (i.e., the input is a function of the 
output). A simple closed-loop system is illustrated in Fig. 1-1. The physical system (process) 
to be controlled is called the plant. Usually a system, called the control actuator, is required to 
drive the plant; in Fig. 1-1 the actuator has been included in the plant. The sensor (or sensors) 
measures the response of the plant, which is then compared to the desired response. This differ- 
ence signal initiates actions that result in the actual response approaching the desired response, 
which drives the difference signal toward zero. Generally, an unacceptable closed-loop 
response occurs if the plant input is simply the difference between the desired response and 
actual response. Instead, this difference signal must be processed (filtered) by another physi- 
cal system, which is called a compensator, a controller, or simply a filter. One problem of the 
control system designer is the design of the compensator. 

An example of a closed-loop system is the case of a pilot landing an aircraft. For this 
example, in Fig. 1-1 the plant is the aircraft and the plant inputs are the pilot’s manipulations of 
the various control surfaces and of the aircraft velocity. The pilot is the sensor, with his or her 
visual perceptions of position, velocity, instrument indications, and so on, and with his or her 
sense of balance, motion, and so on. The desired response is the pilot’s concept of the desired 
flight path. The compensation is the pilot’s manner of correcting perceived errors in flight path. 
Hence, for this example, the compensation, the sensor, and the generation of the desired response 
are all functions performed by the pilot. It is obvious from this example that the compensation 
must be a function of plant (aircraft) dynamics. A pilot trained only in a fighter aircraft is not 
qualified to land a large passenger aircraft, even if he or she can manipulate the controls. 

We will consider systems of the type shown in Fig. 1-1, in which the sensor is an appro- 
priate measuring instrument and the compensation function is performed by a digital computer. 
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FIGURE 1-1 Closed-loop system. 


The plant has dynamics; we will program the computer such that it has dynamics of the same 
nature as those of the plant. Furthermore, although generally we cannot choose the dynamics 
of the plant, we can choose those of the computer such that, in some sense, the dynamics of 
the closed-loop system are satisfactory. For example, if we are designing an automatic aircraft 
landing system, the landing must be safe, the ride must be acceptable to the pilot and to any pas- 
sengers, and the aircraft cannot be unduly stressed. 

Both classical and modern control techniques of analysis and design are developed in this 
book. Almost all control-system techniques developed are applicable to linear time-invariant 
discrete-time system models. A linear system is one for which the principle of superposition 
applies [1]. Suppose that the input of a system x(t) produces a response (output) y,(f), and the 
input x,(t) produces the response y(t). Then, if the system is linear, the principle of superposi- 
tion applies and the input [a,x,(t) + a>x,(t)] will produce the output [a, y(t) + ay y>(t)], where 
a, and a, are any constants. All physical systems are inherently nonlinear; however, in many 
systems, if the system signals vary over a narrow range, the system responds in a linear manner. 
Even though the analysis and design techniques presented are applicable to linear systems only, 
certain nonlinear effects will be discussed. 

When the parameters of a system are constant with respect to time, the system is called a 
time-invariant system. An example of a time-varying system is the booster stage of a space vehicle, 
in which fuel is consumed at a known rate; for this case, the mass of the vehicle decreases with time. 

A discrete-time system has signals that can change values only at discrete instants of time. 
We will refer to systems in which all signals can change continuously with time as continuous-time, 
or analog, systems. 

The compensator, or controller, in this book is a digital filter. The filter implements a trans- 
fer function. The design of transfer functions for digital controllers is the subject of Chapters 2 
through 9 and 11. Once the transfer function is known, algorithms for its realization must be 
programmed on a digital computer. In Chapter 10 we introduce system identification methods 
to model the plant’s dynamic behavior. In Chapter 12 we present several case studies in digital 
controls systems design. 

Presented next in this chapter is an example digital control system. Then the equations 
describing three typical plants that appear in closed-loop systems are developed. 


1.2 DIGITAL CONTROL SYSTEM 


The basic structure of a digital control system will be introduced through the example of an auto- 
matic aircraft landing system. The system to be described is similar to the landing system that is 
currently operational on U.S. Navy aircraft carriers [2]. Only the simpler aspects of the system 
will be described. 


1.2 Digital Control System 


The automatic aircraft landing system is depicted in Fig. 1-2. The system consists of three 
basic parts: the aircraft, the radar unit, and the controlling unit. During the operation of this con- 
trol system, the radar unit measures the approximate vertical and lateral positions of the aircraft, 
which are then transmitted to the controlling unit. From these measurements, the controlling unit 
calculates appropriate pitch and bank commands. These commands are then transmitted to the 
aircraft autopilots, which in turn cause the aircraft to respond accordingly. 

In Fig. 1-2 the controlling unit is a digital computer. The lateral control system, which 
controls the lateral position of the aircraft, and the vertical control system, which controls the 
altitude of the aircraft, are independent (decoupled). Thus the bank command input affects 
only the lateral position of the aircraft, and the pitch command input affects only the alti- 
tude of the aircraft. To simplify the treatment further, only the lateral control system will be 
discussed. 

A block diagram of the lateral control system is given in Fig. 1-3. The aircraft lateral posi- 
tion, y(f), is the lateral distance of the aircraft from the extended centerline of the runway. The 
control system attempts to force y(f) to zero. The radar unit measures y(t) every 0.05 s. Thus 
y(kT) is the sampled value of y(t), with T = 0.05 s and k = 0,1,2,3,.... The digital controller 
processes these sampled values and generates the discrete bank commands (kT). The data hold, 
which is on board the aircraft, clamps the bank command (f) constant at the last value received 
until the next value is received. Then the bank command is held constant at the new value until 
the following value is received. Thus the bank command is updated every T = 0.05 s, which is 
called the sample period. The aircraft responds to the bank command, which changes the lateral 
position y(t). 

Two additional inputs are shown in Fig. 1-3. These are unwanted inputs, called distur- 
bances, and we would prefer that they not exist. The first, w(d), is the wind input, which certainly 
affects the position of the aircraft. The second disturbance input, labeled radar noise, is present 
since the radar cannot measure the exact position of the aircraft. This noise is the difference 
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FIGURE 1-2 Automatic aircraft landing system. 
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FIGURE 1-3 Aircraft lateral control system. 


between the exact aircraft position and the measured position. Since no sensor is perfect, sensor 
noise is always present in a control system. 

The design problem for this system is to maintain y(f) at a small level in the presence of the 
wind and radar-noise disturbances. In addition, the plane must respond in a manner that both is 
acceptable to the pilot and does not unduly stress the structure of the aircraft. 

To effect the design, it is necessary to know the mathematical relationships between the 
wind input w(t), the bank command input (t), and the lateral position y(t). These mathemati- 
cal relationships are referred to as the mathematical model, or simply the model, of the aircraft. 
For example, for the McDonnell-Douglas Corporation F4 aircraft, the model of lateral system is 
a ninth-order ordinary nonlinear differential equation [3]. For the case in which the bank com- 
mand (f) remains small in amplitude, the nonlinearities are not excited and the system model 


1.3 The Control Problem 


described by this ninth-order ordinary nonlinear differential equation may be used for design 
purposes. 

The task of the control system designer is to specify the processing to be accomplished 
in the digital controller. This processing will be a function of the ninth-order aircraft model, the 
expected wind input, the radar noise, the sample period 7, and the desired response characteris- 
tics. Various methods of digital controller design are developed in Chapters 8, 9, and 11. 

The development of the ninth-order model of the aircraft is beyond the scope of this book. 
In addition, this model is too complex to be used in an example in this book. Hence, to illustrate 
the development of models of physical systems, the mathematical models of four simple, but 
common, control-system plants will be developed later in this chapter. Two of the systems relate 
to the control of position, the third relates to temperature control, and the fourth one describes 
control of electrical power in single-machine infinite bus models of power systems. In addition, 
Chapter 10 presents procedures for determining the model of a physical system from input- 
output measurements of the system. 


1.3 THE CONTROL PROBLEM 


We may state the control problem as follows. A physical system or process is to be accurately 
controlled through closed-loop, or feedback, operation. An output variable (signal), called the 
response, is adjusted as required by an error signal. The error signal is a measure of the differ- 
ence between the system response, as determined by a sensor, and the desired response. 
Generally, a controller, or filter, is required to process the error signal in order that certain 
control criteria, or specifications, will be satisfied. The criteria may involve, but not be limited to: 


1. Disturbance rejection 

2. Steady-state errors 

3. Transient response 

4. Sensitivity to parameter changes in the plant 


Solving the control problem will generally involve: 


1. Choosing sensors to measure the required feedback signals 

. Choosing actuators to drive the plant 

. Developing the plant, sensor, and actuator models (equations) 

. Designing the controller based on the developed models and the control criteria 

. Evaluating the design analytically, by simulation, and finally, by testing the physical 
system 

6. Iterating this procedure until a satisfactory physical-system response results 


nb WN 


Because of inaccuracies in the mathematical models, the initial tests on the physical system may 
not be satisfactory. The controls engineer must then iterate this design procedure, using all tools 
available, to improve the system. Intuition, developed while experimenting with the physical 
system, usually plays an important part in the design process. 

Fig. 1-4 illustrates the relationship of mathematical analysis and design to physical-system 
design procedures [4]. In this book, all phases shown in the Fig. are discussed, but the emphasis 
is necessarily on the conceptual part of the procedures—the application of mathematical con- 
cepts to mathematical models. In practical design situations, however, the major difficulties are 
in formulating the problem mathematically and in translating the mathematical solution back to 
the physical world. Many iterations of the procedures shown in Fig. 1-4 are usually required in 
practical situations. 
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FIGURE 1-4 Mathematical solutions for physical systems. 


Depending on the system and the experience of the designer, some of the steps listed ear- 
lier may be omitted. In particular, many control systems are implemented by choosing standard 
forms of controllers and experimentally determining the parameters of the controller; a specified 
step-by-step procedure is applied directly to the physical system, and no mathematical models 
are developed. This type of procedure works very well for certain control systems. For other 
systems, it does not. For example, a control system for a space vehicle cannot be designed in this 
manner; this system must perform satisfactorily the first time it is activated. 

In this book mathematical procedures are developed for the analysis and design of control 
systems. The techniques developed may or may not be of value in the design of a particular con- 
trol system. However, standard controllers are utilized in the developments in this book. Thus 
the analytical procedures develop the concepts of control system design and indicate applica- 
tions of each of the standard controllers. 


1.4 SATELLITE MODEL 


As the first example of the development of the mathematical model of a physical system, we will 
consider the attitude control system of a satellite. Assume that the satellite is spherical and has 
the thruster configuration shown in Fig. 1-5. Suppose that 6(f) is the yaw angle of the satellite. 
In addition to the thrusters shown, thrusters will also control the pitch angle and the roll angle, 
giving complete three-axis control of the satellite. We will consider only the yaw-axis control 
systems, whose purpose is to control the angle 0(f). 

For the satellite, the thrusters, when active, apply a torque t(7). The torque of the two 
active thrusters shown in Fig. 1-5 tends to reduce @(f). The other two thrusters shown tend to 
increase @(f). 

Since there is essentially no friction in the environment of a satellite, and assuming the 
satellite to be rigid, we can write 


PAA 
J T~ (À (1-1) 
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e(t) 


a— Thrusters 


Thrusters 


FIGURE 1-5 Satellite. 


where J is the satellite’s moment of inertia about the yaw axis. We now derive the transfer func- 
tion by taking the Laplace transform of (1-1): 


Js°O(s) = T(s) = LO] (1-2) 
Initial conditions are ignored when deriving transfer functions. Equation (1-2) can be expressed as 


O(s) _ ol 
T(s) pS) Js (1-3) 


The ratio of the Laplace transforms of the output variable [6(7)] to input variable [t(¢)] is called 
the plant transfer function, and is denoted here as G,(s). A brief review of the Laplace transform 
is given in Appendix V. 

The model of the satellite may be specified by either the second-order differential equation 
of (1-1) or the second-order transfer function of (1-3). A third model is the state-variable model, 
which we will now develop. Suppose that we define the variables x,(t) and x,(f) as 


aO =O (1-4) 
x(t) = x(t) = 0M (1-5) 


where x,(t) denotes the derivative of x(t) with respect to time. Then, from (1-1) and (1-5), 


. 1 
x(t) = O(t) = rau) (1-6) 


where 6(t) is the second derivative of 6(t) with respect to time. 
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We can now write (1-5) and (1-6) in vector-matrix form (see Appendix IV): 


EA a o de 7 
x} LO OlLx@ 


In this equation, x(t) and x(t) are called the state variables. Hence we may specify the model of 
the satellite in the form of (1-1), or (1-3), or (1-7). State-variable models of analog systems are 
considered in greater detail in Chapter 4. 


T(t) (1-7) 


we o 


1.5 SERVOMOTOR SYSTEM MODEL 


In this section the model of a servo system (a positioning system) is derived. An example of this 
type of system is an antenna tracking system. In this system, an electric motor is utilized to rotate 
a radar antenna that tracks an aircraft automatically. The error signal, which is proportional to 
the difference between the pointing direction of the antenna and the line of sight to the aircraft, is 
amplified and drives the motor in the appropriate direction so as to reduce this error. 

A dc motor system is shown in Fig. 1-6. The motor is armature controlled with a constant 
field. The armature resistance and inductance are R, and L,, respectively. We assume that the 
inductance L, can be ignored, which is the case for many servomotors. The motor back emf e(t) 
is given by [5] 


_ _ „WO 
Ent) = Kro (t) > Ky (1-8) 


where 0(f) is the shaft position, w(f) is the shaft angular velocity, and K, is a motor-dependent 
constant. The total moment of inertia connected to the motor shaft is J, and B is the total viscous 
friction. Letting T(t) be the torque developed by the motor, we write 


2, 
no = 1200, p20 
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FIGURE 1-6 Servomotor system. 


1.5 Servomotor System Model 


The developed torque for this motor is given by 
(t) = Krit) (1-10) 


where i(t) is the armature current and Ky is a parameter of the motor. The final equation required 
is the voltage equation for the armature circuit: 


e(t) = IOR, + eÀ (1-11) 


These four equations may be solved for the output (f) as a function of the input e(t). First, 
from (1-11) and (1-8), 


ED nD) _ et) — K, do 


i(t 1-12 
i) R, R, R, dt oy) 
Then, from (1-9), (1-10), and (1-12), 
Kr KrK, d0(t) POA) d0(t) 
t) = K;i(t) = t =J +B 1-13 
T(t) ri(t) R, e(t) Rd a P? (1-13) 
This equation may be written as 
@0(t) BR, + KK, d K 
as eNO (1-14) 


dt’ R, dt R, 


which is the desired model. This model is second order; if the armature inductance cannot be 
neglected, the model is third order [6]. 
Next we take the Laplace transform of (1-14) and solve for the transfer function: 


ois K;/R, Kr/JR, 
(O (5) = 7/ E T/ (1-15) 
Es) > BR, + KrK, BR, + KK, 
Js? + 2s ss + — 2 
R, JR, 


Many of the examples of this book are based on this transfer function. 
The state-variable model of this system is derived as in the preceding section. 


Let 
aO= aie 
X(t) = O(1) = xA 
Then, from (1-14), 
f a8 BR, + KrK, Kr 
x(t) = 0) = TR x(t) + TR e(t) (1-17) 
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Hence the state equations may be written as 


: 0 1 
Ba = BR, + KrK, Be +| Kr |e(t) (1-18) 
X(t) 0 — R X(t) JR 


Antenna Pointing System 


We define a servomechanism, or more simply, a servo, as a system in which mechanical posi- 
tion is controlled. Two servo systems, which in this case form an antenna pointing system, are 
illustrated in Fig. 1-7. The top view of the pedestal illustrates the yaw-axis control system. The 
yaw angle, 0(f), is controlled by the electric motor and gear system (the control actuator) shown 
in the side view of the pedestal. 
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proportional 
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(b) (c) 
FIGURE 1-7 Servo control system. 


1.5 Servomotor System Model 


The pitch angle, (f), is shown in the side view. This angle is controlled by a motor and 
gear system within the pedestal; this actuator is not shown. 

We consider only the yaw-axis control system. The electric motor rotates the antenna and 
the sensor, which is a digital shaft encoder [7]. The output of the encoder is a binary number that 
is proportional to the angle of the shaft. For this example, a digital-to-analog converter is used 
to convert the binary number to a voltage v,(f) that is proportional to the angle of rotation of the 
shaft. Later we consider examples in which the binary number is transmitted directly to a digital 
controller. 

In Fig. 1-7(a) the voltage v,(t) is directly proportional to the yaw angle of the antenna, and 
the voltage v,(f) is directly proportional (same proportionality constant) to the desired yaw angle. 
If the actual yaw angle and the desired yaw angle are different, the error voltage e(f) is nonzero. 
This voltage is amplified and applied to the motor to cause rotation of the motor shaft in the 
direction that reduces the error voltage. 

The system block diagram is given in Fig. 1-7(b). Since the error signal is normally a 
low-power signal, a power amplifier is required to drive the motor. However, this amplifier 
introduces a nonlinearity, since an amplifier has a maximum output voltage and can be saturated 
at this value. Suppose that the amplifier has a gain of 5 and a maximum output of 24 V. Then 
the amplifier input—output characteristic is as shown in Fig. 1-7(c). The amplifier saturates at an 
input of 4.8 V; hence, for an error signal larger than 4.8 V in magnitude, the system is nonlinear. 

In many control systems, we go to great lengths to ensure that the system operation is 
confined to linear regions. In other systems, we purposely design for nonlinear operation. For 
example, in this servo system, we must apply maximum voltage to the motor to achieve maxi- 
mum speed of response. Thus for large error signals we would have the amplifier saturated in 
order to achieve a fast response. 

The analysis and design of nonlinear systems is beyond the scope of this book; we will 
always assume that the system under consideration is operating in a linear mode. 


Robotic Control System 


A line drawing of an industrial robot is shown in Fig. 1-8. The basic element of the control sys- 
tem for each joint of many robots is a servomotor. We take the usual approach of considering 
each joint of the robot as a simple servomechanism, and ignore the movements of the other joints 
in the arm. Although this approach is simple in terms of analysis and design, the result is often 
less than desirable control of the joint [8]. 


FIGURE 1-8 Schematic diagram of a robotic arm with three angles of motion. 
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FIGURE 1-9 Model of robot arm joint. 


The model of a single robot arm joint is given in Fig. 1-9, where the second-order model 
of the servomotor is assumed. In addition, it is assumed that the arm is attached to the motor 
through gears, with a gear ratio of n. If the armature inductance of the motor cannot be ignored, 
the model is third order [8]. In this model, E,(s) is the armature voltage, and is used to control 
the position of the arm. The input signal M(s) is assumed to be from a digital computer, and the 
power amplifier K is required since a computer output signal cannot drive the motor. The angle 
of the motor shaft is ©,,(s), and the angle of the arm is ©,(s). Same holds for the two other arm 
angles @,(s) and ©,(s). As described above, the inertia and friction of both the gears and the 
arm are included in the servomotor model, and hence the model shown is the complete model 
of the robot joint. This model will be used in several problems that appear at the ends of the 
chapters. 


1.6 TEMPERATURE CONTROL SYSTEM 


As a third example of modeling, a thermal system will be considered. It is desired to control the 
temperature of a liquid in a tank. Liquid is flowing out at some rate, being replaced by liquid 
at temperature 7,7) as shown in Fig. 1-10. A mixer agitates the liquid such that the liquid tem- 
perature can be assumed uniform at a value T(t) throughout the tank. The liquid is heated by an 
electric heater. 


Input flow at 
temperature T; 


DO 


Liquid at 
temperature T 


Ambient temperature 
of air = T, 


Heater 3 


Output flow at 


— r 
<i temperature T 


Mixer 
FIGURE 1-10 Thermal system. 


1.6 Temperature Control System 


We first make the following definitions: 


q(t) = heat flow supplied by the electric heater 
q(t) = heat flow via liquid entering the tank 
q(t) = heat flow into the liquid 

q(t) = heat flow via liquid leaving the tank 
q(t) = heat flow through the tank surface 


By the conservation of energy, heat added to the tank must equal that stored in the tank plus that 
lost from the tank. Thus 


get) + gt) = gt) + g(t) + g(t) (1-19) 

Now [9] 
2608 1-20 
q(t) = a (1-20) 


where C is the thermal capacity of the liquid in the tank. Letting v(t) equal the flow into and out 
of the tank (assumed equal) and H equal the specific heat of the liquid, we can write 


qi) = VAHT) (1-21) 
and 
dot) = WOAT(t) (1-22) 


Let 1,(t) be the ambient temperature outside the tank and R be the thermal resistance to heat flow 
through the tank surface. Then 


fj OS a (1-23) 


Substituting (1-20) through (1-23) into (1-19) yields 


zo + vpHa() + EW aa 


gt) + VAHT (A = C 
We now make the assumption that the flow v(t) is constant with the value V; otherwise, the last 
differential equation is time-varying. Then 


dv(t) T(t) — T(t) 
GOH VERO C= t VERO (1-24) 


This model is a first-order linear differential equation with constant coefficients. In terms of a 
control system, q(t) is the control input signal, T(t) and T,(t) are disturbance input signals, and 
T(t) is the output signal. 
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FIGURE 1-11 Block diagram of a thermal system. 


Taking the Laplace of (1-24) and solving for T(s) = L£[1(d)] yields 


Q.(s) VHT(s) (1/R) T,(s) 
Cs + VH + (1/R) Cs+VH+(1/R) Cs + VH + (1/R) 


T(s) = (1-25) 


Different configurations may be used to express (1-25) as a block diagram; one is given in 
Fig. 1-11. 

If we ignore the disturbance inputs, the transfer-function model of the system is simple and 
first order. However, at some step in the control system design the disturbances must be consid- 
ered. Quite often a major specification in a control system design is the minimization of system 
response to disturbance inputs. 

The model developed in this section also applies directly to the control of the air tempera- 
ture in an oven or a test chamber. For many of these systems, no air is introduced from the out- 
side; hence the disturbance input q;(t) is zero. Of course, the parameters for the liquid in (1-25) 
are replaced with those for air. 


1.7 SINGLE-MACHINE INFINITE BUS POWER SYSTEM 


A single-machine infinite bus (SMIB) power system, as shown in Fig. 1-12, is often used as 
the starting model for understanding dynamics and stability of large power grids. The system 
consists of a synchronous generator G, which in many cases may represent the equivalent model 
of a larger area containing multiple synchronous machines inside it, supplying electrical power 
across a lossless transmission line to a load connected to a fixed or stationary point, commonly 
referred to as the infinite bus. The relevance of the term “infinite” is that this bus can also be 
viewed as a generator with theoretically infinite inertia, implying that the voltage and phase 
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FIGURE 1-12 Single-machine infinite bus power system. 


1.7 Single-Machine Infinite Bus Power System 


angle at this bus always remain static or constant, and thereby serve as a reference for quantita- 
tive analysis of the phase angle oscillations of the other generator(s) in the system. Therefore, 
for convenience, it is always assumed that the voltage at the infinite bus is 1 per unit, while the 
phase angle is 0 degrees. To derive the model of the SMIB power system, we next introduce the 
following set of symbols: 

ò phase angle of the synchronous generator (radians) 

w angular speed (radian/sec) 

w, synchronous speed, equal to 1207 rad/s for a 60 Hz system 

E internal constant voltage of the generator (per unit) 

x} direct-axis salient reactance (per unit) 

Xr transformer reactance (per unit) 

x, transmission line reactance (per unit) 

d damping constant 

M generator electro-mechanical inertia 

P,, mechanical power input from turbine to generator (per unit) 

P, electrical power output from generator to infinite bus (per unit) 


For details of the physical meanings of the above notations please see [10]. The dynamic model 
of the SMIB system can be written by applying Newton’s second law of motion as 


=o- a, 
Mo = P, — P, — dw (1-26) 
which implies that the imbalance between input and output power flow causes the rotor of the 


synchronous generator to accelerate. From electric circuit law, the total complex power flowing 
from G to the infinite bus can be written as 


P = (EL8)I- (1-27) 


where, E28 = E( cos ò + j sin ò), T is the current phasor which is flowing out of the machine, 
and the superscript * means complex conjugate. From Kirchoff’ s law this current can be written as 
a EZ6 — 120 
t= (1-28) 
Ja + xr + x) 


where 120 is the voltage phasor at the infinite bus, while the expression in the denominator 
denotes the total reactance between the generator and the infinite bus. For simplicity of notation 
let us denote x = x4 + xr + xı. Then the expression for the current phasor can be simplified as 
ie Ecos8 — 1+ jE sinò 

jx 


(1-29) 
from which P, after a few simple calculations, can be shown as 


P= = (sin8 + j(E — cos 8)) (1-30) 
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Since P, in (1-26) represents only the real part of P, therefore another way to write (1-26) is 


5 w~ w 


L (1-31) 
Mo = P, — 5 sind — dw 


Equation (1-31) gives the continuous-time state-variable model for the SMIB system. The model, 
however, is nonlinear because of the sin ò term in the RHS of the second equation. Hence, we 
linearize this model across an equilibrium of (6 = 55, = w,) to obtain a linear time-invariant 
model of the form 


Aé 0 l IFAs : 
[2$] =| Ecos d | |+ 1 |AP, (1-32) 
" Mx mu | ° M 


where A stands for the small-signal perturbation of the corresponding states and inputs from 
their respective equilibrium values. The output can be considered as the change in electric power 
P, as 


_ Ecos 8&o 


AP, AS = kA8 (1-33) 


The transfer function for the system (1-32) and (1-33) with input AP,, and output AP, can be 
derived as 


k 


GE) = — 
p) = Ms + ds +k 


(1-34) 


G,(s) gives the open-loop transfer function between the small-signal mechanical power input 
and the electrical power output of the synchronous machine. It can be seen that the steady-state 
gain (s = 0) of G,(s) is 1, which means that in steady state the mechanical power input to the 
machine must exactly balance its electrical power output. The transient response of the output 
for a unit change in the input, however, may not be satisfactory to the user as it is. Therefore, 
one may design an output-feedback controller C(s) to control the transient response of the elec- 
trical power, as shown in the block diagram in Fig. 1-13. C(s) must be designed so that the 
steady-state gain of the closed-loop transfer function is 1. Depending on the values of M, d, and k, 
the open-loop response may not be satisfactory in terms of damping, percent peak overshoot, 
settling time, etc. The controller C(s) can be designed to achieve these transient performance 
specifications. 


k AP 


~ Ms*+ds+k 


FIGURE 1-13 Block diagram of a closed-loop SMIB power system model. 
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In this chapter we have introduced the concepts of a closed-loop control system. Next, models of 
four physical systems were discussed. First, a model of a satellite was derived. Next, the model of a 
servomotor was developed; then two examples, an antenna pointing system and a robot arm, were 
discussed. Next, a model was developed for control of the temperature of a tank of liquid. Finally, 
a model for a single-machine infinite bus (SMIB) power system was presented. These systems are 
continuous time, and generally, the Laplace transform is used in the analysis and design of these 
systems. In the next chapter we extend the concepts of this chapter to a system controlled by a digital 
computer and introduce some of the mathematics required to analyze and design this type of system. 
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1.1-1. (a) Show that the transfer function of two systems in parallel, as shown in Fig. P1.1-l(a), is equal to the 


sum of the transfer functions. 


(b) Show that the transfer function of two systems in series (cascade), as shown in Fig. Pl.1-1(b), is equal 


to the product of the transfer functions. 
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FIGURE P1.1-1 Systems for Problem 1.1-1. 
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By writing algebraic equations and eliminating variables, calculate the transfer function C(s)/R(s) for the 
system of: 

(a) Figure P1.1-2(a). 

(b) Figure P1.1-2(b). 

(c) Figure P1.1-2(c). 
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Mls) G,(s) oe 
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H(s) 


(a) 


R(s) C(s) 


C(s) 
=| G(s) > 


Hi,(s) 


(c) 


FIGURE P1.1-2 Systems for Problem 1.1-2. 


1.1-3. 


1.1-4. 


Use Mason’s gain formula of Appendix II to verify the results of Problem 1.1-2 for the system of: 
(a) Figure P1.1-2(a). 
(b) Figure P1.1-2(b). 
(c) Figure P1.1-2(c). 


A feedback control system is illustrated in Fig. P1.1-4. The plant transfer function is given by 


4 


CA) = 03541 


(a) Write the differential equation of the plant. This equation relates c(t) and m(t). 
(b) Modify the equation of part (a) to yield the system differential equation; this equation relates c(t) and 
r(t). The compensator and sensor transfer functions are given by 


Gs) = 20, A(s) = 1 
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(c) Derive the system transfer function from the results of part (b). 
(d) It is shown in Problem 1.1-2(a) that the closed-loop transfer function of the system of Fig. P1.1-4 is 
given by 


Cs) _ G,(s)G,(s) 
R(s) 1 + G.(s)Gp(s)H(s) 


Use this relationship to verify the results of part (c). 
(e) Recall that the transfer-function pole term (s + a) yields a time constant t = 1/a, where a is real. 
Find the time constants for both the open-loop and closed-loop systems. 


Compensator Plant 
R(s Es Ms Cs 
O t 6) G.(s) ®) G,(s) @ 
Sensor 
H(s) 


FIGURE P1.1-4 Feedback control system. 


1.1-5. 


1.1-6. 


1.4-1. 


Repeat Problem 1.1-4 with the transfer functions 


3s + 5 


GAs) = 4, GUS => 
fs) As) v+4s+4 


A(s) = 1 


For part (e), recall that the transfer-function underdamped pole term [(s + ay’ + b] yields a time constant, 
T= l/a. 
Repeat Problem 1.1-4 with the transfer functions 

4 
$+2s+1 
The satellite of Section 1.4 is connected in the closed-loop control system shown in Fig. P1.4-1. The torque 
is directly proportional to the error signal. 
(a) Derive the transfer function @(s)/O,(s), where (t) = £-'[@(s)] is the commanded attitude angle. 
(b) The state equations for the satellite are derived in Section 1.4. Modify these equations to model the 


closed-loop system of Fig. P1.4-1. 
a 


‘a— Thrusters 


\\ 


G(s) =4, G,(s) = 


Thrusters Z 


(a) 


FIGURE P1.4-1 Satellite control system. 
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FIGURE P1.4-1 (continued) 


1.4-2. (a) In the system of Problem 1.4-1, J = 0.6 and K = 12.4, in appropriate units. The attitude of the satel- 
lite is initially at 0°. At £ = 0, the attitude is commanded to 40°; that is, a 40° step is applied at t = 0. 
Find the response (t). 
(b) Repeat part (a), with the initial conditions 6(0) = 10° and 6(0) = 30°/s. Note that we have assumed 
that the units of time for the system is seconds. 
(c) Verify the solution in part (b) by first checking the initial conditions and then substituting the solution 
into the system differential equation. 

1.4-3. The input to the satellite system of Fig. P1.4-1 is a step function 6,(f) = 4u(t) in degrees. As a result, the 
satellite angle 6(7) varies sinusoidally at a frequency of 20 cycles per minute. Find the amplifier gain K and 
the moment of inertia J for the system, assuming that the units of time in the system differential equation 
are seconds. 

1.4-4. The satellite control system of Fig. P1.4-1 is not usable, since the response to any excitation includes 
an undamped sinusoid. The usual compensation for this system involves measuring the angular velocity 
d@(1)/dt. The feedback signal is then a linear sum of the position signal 0(t) and the velocity signal d@(1)/dt. 
This system is depicted in Fig. P1.4-4, and is said to have rate feedback. 

(a) Derive the transfer function O(s)/@,(s) for this system. 

(b) The state equations for the satellite are derived in Section 1.4. Modify these equations to model the 
closed-loop system of Fig. P1.4-4. 

(c) The state equations in part (b) can be expressed as 


x(t) = Ax(t) + BOÐ 


Satellite 


SSS SSS SSS Se SS SS SSF 


FIGURE P1.4-4 Satellite control system with rate feedback. 
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The system characteristic equation is 
|sI - A] =0 


Show that |sI — A| in part (b) is equal to the transfer function denominator in part (a). 


1.5-1. The antenna positioning system described in Section 1.5 is shown in Fig. P1.5—1. In this problem we 


consider the yaw angle control system, where 0(f) is the yaw angle. Suppose that the gain of the power 


amplifier is 5 V/V, and that the gear ratio and the angle sensor (the shaft encoder and the data hold) are 
such that 


v(t) = 0.020 


where the units of v,(t) are volts and of @(t) are degrees. Let e(t) be the input voltage to the motor; the 
transfer function of the motor pedestal is given as 


Os) 20 
Es) s(s + 4) 


Side view 
of pedestal 


Foo 


sg Antenna 
Difference Power 


amplifier amplifier 


Gears 
Motor 
voltage 


p=y 
Voltage —— 
proportional 
to desired 
angle 


N~ shaft 


encoder 
Data 
Voltage hold 
proportional f 
to angle Binary 
code 
Top view of pedestal 
(a) 
Input Power 
gain amplifier Motor/antenna 
O(s) V;(s) + E(s) O(s) 
>| » K |» 


Sensor 


V,(s) 


(b) 


FIGURE P1.5-1 System for Problem 1.5-1. 
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1.5-3. 


1.5-4. 
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(a) With the system open loop [v,(t) is always zero], a unit step function of voltage is applied to the 
motor [E(s) = 1/s]. Consider only the steady-state response. Find the output angle 0(f) in degrees, 
and the angular velocity of the antenna pedestal, 6(/), in both degrees per second and rpm. 

(b) The system block diagram is given in Fig. P1.5-1(b), with the angle signals shown in degrees and the 
voltages in volts. Add the required gains and the transfer functions to this block diagram. 

(c) Make the changes necessary in the gains in part (b) such that the units of 0(f) are radians. 

(d) A step input of 6,(f) = 10° is applied at the system input at t = 0. Find the response @(f). 

(e) The response in part (d) reaches steady state in approximately how many seconds? 

The state-variable model of a servomotor is given in Section 1.5. Expand these state equations to model the 

antenna pointing system of Problem 1.5-1(b). 

(a) Find the transfer function ©(s)/@,(s) for the antenna pointing system of Problem 1.5-1(b). This transfer 
function yields the angle 6(t) in degrees. 

(b) Modify the transfer function in part (a) such that use of the modified transfer function yields 0(t) in 
radians. 

(c) Verify the results of part (b) using the block diagram of Problem 1.5-1(b). 

Shown in Fig. P1.5-4 is the block diagram of one joint of a robot arm. This system is described in 

Section 1.5. The input M(s) is the controlling signal, E,(s) is the servomotor input voltage, @,,(s) is the 

motor shaft angle, and the output @,(s) is the angle of the arm. The inductance of the armature of the 

servomotor has been neglected such that the servomotor transfer function is second order. The servomo- 
tor transfer function includes the inertia of both the gears and the robot arm. Derive the transfer functions 

@,(s)/M(s) and O,(s)/E,(s). 
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FIGURE P1.5-4 A model of a robot arm. 


1.5-5. 


1.6-1. 


Consider the robot arm depicted in Fig. P1.5-4. 

(a) Suppose that the units of e,(t) are volts, that the units of both 0,,(f) and 0,(f) are degrees, and that the 
units of time are seconds. If the servomotor is rated at 24 V [the voltage e,(t) should be less than or 
equal to 24 V], find the rated rpm of the motor (the motor rpm, in steady state, with 24 V applied). 

(b) Find the maximum rate of movement of the robot arm, in degrees per second, with a step voltage of 
e,(t) = 24u(t) volts applied. 

(c) Assume that e,(t) is a step function of 24 V. Give the time required for the arm to be moving at 99 per- 
cent of the maximum rate of movement found in part (b). 

(d) Suppose that the input m(t) is constrained by system hardware to be less than or equal to 10 V in mag- 
nitude. What value would you choose for the gain K. Why? 

A thermal test chamber is illustrated in Fig. P1.6-1(a). This chamber, which is a large room, is used to test 

large devices under various thermal stresses. The chamber is heated with steam, which is controlled by an 

electrically activated valve. The temperature of the chamber is measured by a sensor based on a thermis- 
tor, which is a semiconductor resistor whose resistance varies with temperature. Opening the door into the 
chamber affects the chamber temperature and thus must be considered as a disturbance. 
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FIGURE P1.6-1 A thermal stress chamber. 
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A simplified model of the test chamber is shown in Fig. P1.6-1(b), with the units of time in minutes. The 
control input is the voltage e(t), which controls the valve in the steam line, as shown. For the disturbance 
d(t), a unit step function is used to model the opening of the door. With the door closed, d(t) = 0. 
(a) Find the time constant of the chamber. 
(b) With the controlling voltage e(t) = 4u(f) and the chamber door closed, find and plot the chamber tem- 
perature c(t). In addition, give the steady-state temperature. 
(c) A tacit assumption in part (a) is an initial chamber temperature of zero degrees Celsius. Repeat part (b), 
assuming that the initial chamber temperature is c(0) = 25°C. 
(d) Two minutes after the application of the voltage in part (c), the door is opened, and it remains open. 
Add the effects of this disturbance to the plot of part (c). 
(e) The door in part (d) remains open for 12 min. and is then closed. Add the effects of this disturbance to 


the plot of part (d). 


The thermal chamber transfer function C(s)/E(s) = 2.5/(s + 1) is based on the units of time being 


minutes. 


(a) Modify this transfer function to yield the chamber temperature c(t) based on seconds. 
(b) Verify the result in part (a) by solving for c(t) with the door closed and the input e(t) = 4u(t) volts, 
(i) using the chamber transfer function found in part (a), and (ii) using the transfer function of 
Fig. P1.6-1. Show that (i) and (ii) yield the same temperature at t = 1 min. 
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1.7-1. 


1.7-2. 


1.7-3. 


Chapter 1 ° Introduction 


Consider the single-machine infinite bus power system of Fig. 1-13 with M = 0.5, d = 0.1, and k = 10. 
Find the steady-state gain of the closed-loop transfer function when: 


(a) C(s) = 1 

(b) Cs) = 1 + 2s 

(c) C(s) = — a 
si + 25+ 8 


Consider the single-machine infinite bus power system of Fig. 1-13 with M = 0.5,d = 0.1, k = 10, 
and C(s) = 1. Simulate the unit step response for this system, and compute the rise time of the output AP.. 
Repeat the same for M = 1 and M = 10, and observe how the rise time is affected by increasing the iner- 
tia M. What is the steady-state value of AP, when k = 100? 
Consider a slightly different block-diagram for the closed-loop single-machine infinite-bus power system 
of Fig. 1-13 as shown below in Fig. P1.7-3. In this block diagram the controller C(s) is placed in cascade to 
the plant instead of in the feedback loop. The feedback gain is considered as unity. 
(a) For this set-up compute the steady-state error between a unit step input AP, and the output AP, for the 

following controller transfer functions: 

(i) C(s) = ao (proportional, or P-controller) 
Gi) C(s) = ag + as (proportional + derivative, or PD controller) 


a 
Gii) C(s) = agọ + 2 (proportional + integral, or PI controller) 
s 


a 
(iv) C(s) = ag + ays + = (proportional + integral + derivative, or PID controller) 
s 


(b) Using M = 0.5, d = 0.1, and k = 10, and a PID controller C(s) = 1 + 2s + m compute the rise 
time of AP,. How does the rise time change when the derivative gain is doubled? 


AP k AP 
£ C(s) G,(s) = —,———_ = 
+ : i Ms? +ds +k 


FIGURE P1.7-3 System for Problem 1.7-3. 
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Discrete-Time Systems and 
the z-Transform 


2.1 INTRODUCTION 


In this chapter two important topics are introduced: discrete-time systems and the z-transform. 
In contrast to a continuous-time system, whose operation is described (modeled) by a set of 
differential equations, a discrete-time system is one whose operation is described by a set of 
difference equations. The transform method employed in the analysis of linear time-invariant 
continuous-time systems is the Laplace transform; in a similar manner, the transform used in 
the analysis of linear time-invariant discrete-time systems is the z-transform. The modeling of 
discrete-time systems by difference equations, transfer functions, and state equations is pre- 
sented in this chapter. 


2.2 DISCRETE-TIME SYSTEMS 


To illustrate the idea of a discrete-time system, consider the digital control system shown in 
Fig. 2-1(a). The digital computer performs the compensation function within the system. The 
interface at the input of the computer is an analog-to-digital (A/D) converter, and is required to 
convert the error signal, which is a continuous-time signal, into a form that can be readily pro- 
cessed by the computer. At the computer output a digital-to-analog (D/A) converter is required 
to convert the binary signals of the computer into a form necessary to drive the plant. 

We will now consider the following example. Suppose that the A/D converter, the digital 
computer, and the D/A converter are to replace an analog, or continuous-time, proportional- 
integral (PI) compensator such that the digital control system response has essentially the same 
characteristics as the analog system. (The PI controller is discussed in Chapter 8.) The analog 
controller output is given by 


m(t) = Kpe(t) + x, f e(t) dt (2-1) 
0 


where e(t) is the controller input signal, m(t) is the controller output signal, and Kp and K; are 
constant gains determined by the design process. 
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Error signal Digital 
Interface computer Interface Plant 
Input + Output 
<) >| AD Da /}-—> 
Sensor 
Lae 
(a) 
A 
a) 
> 
(k—2)T kT t 


(kK-DT REDT 


(b) 
FIGURE 2-1 Digital control system. 


Since the digital computer can be programmed to multiply, add, and integrate numerically, 
the controller equation can be realized using the digital computer. For this example, the rectan- 
gular rule of numerical integration [1], illustrated in Fig. 2-1(b), will be employed. Of course, 
other algorithms of numerical integration may also be used. 

For the rectangular rule, the area under the curve in Fig. 2-1(b) is approximated by the sum 
of the rectangular areas shown. Thus, letting x(t) be the numerical integral of e(t), we can write 


x(kT) = x[(k — IT] + Te(kT) (2-2) 


where T is the numerical algorithm step size, in seconds. Then (2-1) becomes, for the digital 
compensator, 


m(kT) = Kpe(kT) + K,x(kT) 


Equation (2-2) is a first-order linear difference equation. The general form of a first-order 
linear time-invariant difference equation is (with the T omitted for convenience) 


x(k) = bjek) + boe(k — 1) — apx (k — 1) (2-3) 


2.3 Transform Methods 


This equation is first order since the signals from only the last sampling instant appear explicitly 
in the equation. The general form of an nth-order linear difference equation is 
x(k) = belk) + b, -elk — 1) + +++ + boelk — n) 


(2-4) 
— a,—\x(k — 1) se agx(k — n) 


It will be shown in Chapter 5 that if the plant in Fig. 2-1 is also linear and time invariant, the 
entire system may be modeled by a difference equation of the form of (2-4), which is generally 
of higher order than that of the controller. Compare (2-4) to a linear differential equation describ- 
ing an nth-order continuous-time system. 


d"e(t) de(t) 


y(t) = By a" a an Br + Boel) 
DO DO ve 
” de ! dt 


Two approaches may be used in the design of digital compensators. First, an analog 
compensator may be designed and then converted by some approximate procedure to a digital 
compensator, as in the example above. Chapters 3 through 9 and 11 present exact methods of 
designing digital compensators, as compared to the approximate methods of converting analog 
compensators to digital compensators. 

The describing equation of a linear, time-invariant analog (i.e., continuous-time) filter is 
also of the form of (2-5). The device that realizes this filter, usually a RC network with opera- 
tional amplifiers, can be considered to be an analog computer programmed to solve the filter 
equation. In a similar manner, (2-4) is the describing equation of a linear, time-invariant discrete 
filter, which is usually called a digital filter. The device that realizes this filter is a digital com- 
puter programmed to solve (2-4). Thus the digital computer in Fig. 2-1 would be programmed to 
solve a difference equation of the form of (2-4), and the problem of the control system designer 
would be to determine (1) T, the sampling period; (2) n, the order of the difference equation; and 
(3) a; and b;, the filter coefficients, such that the control system has certain desired characteristics. 

There are additional problems in the realization of the digital filter: for example, the 
computer word length required to keep system errors caused by round-off in the computer 
at an acceptable level. As an example, a digital filter (controller) was designed and imple- 
mented to land aircraft automatically on U.S. Navy aircraft carriers [2]. In this system, the 
sample rate is 25 Hz (T = 0.04s), and the controller is eleventh order. The minimum word 
length required for the computer was found to be 32 bits, in order that system errors caused by 
round-off in the computer remain at acceptable levels. As an additional point, this controller is a 
proportional-plus-integral-plus-derivative (PID) controller with extensive noise filtering 
required principally because of the differentiation in the D part of the filter. The integration and 
the differentiation are performed numerically, as is discussed in Chapter 8. In many applica- 
tions other than control systems, digital filters have been designed to replace analog filters and 
the problems encountered are the same as those listed above. 


2.3 TRANSFORM METHODS 


In linear time-invariant continuous-time systems, the Laplace transform can be utilized in sys- 
tem analysis and design. For example, an alternative, but equally valid description of the opera- 
tion of a system described by (2-5) is obtained by taking the Laplace transform of this equation 
and solving for the transfer function: 
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1G) CAB So Bie Bo T 
E(s) a,s"t +++ +a t+ 1 
A transform will now be defined that can be utilized in the analysis of discrete-time sys- 
tems modeled by difference equations of the form given in (2-4). 
A transform is defined for number sequences as follows. The function E(z) is defined as 
a power series in z * with coefficients equal to the values of the number sequence {e(k)}. This 
transform, called the z-transform, is then expressed by the transform pair 


E(z)= #[{e(k)}] = e(0) + e(Dz! + ez! + -+ 


ek) = IEO] = = $ E@z a, j= V-I 


(2-7) 


r 


where z(° ) indicates the z-transform operation and 5 ( + ) indicates the inverse z-transform. 
E(z) in (2-7) can be written in more compact notation as 


oo 


E = HeD = X ekz" (2-8) 


For convenience, we often omit the braces and express ġ[{(e(k)}] as š[e(k)]. However, it should 
be remembered that the z-transform applies to a sequence. 

The z-transform is defined for any number sequence {e(k)}, and may be used in the analy- 
sis of any type of system described by linear time-invariant difference equations. For example, 
the z-transform is used in discrete probability problems, and for this case the numbers in the 
sequence {e(k)} are discrete probabilities [3]. 

Equation (2-7) is the definition of the single-sided z-transform. The double-sided z-transform, 
sometimes called the generating function [4], is defined as 


Gf} = 2 f(kyz* (2-9) 


Throughout this book, only the single-sided z-transform as defined in (2-7) will be used, and this 
transform will be referred to as the ordinary z-transform. If the sequence e(k) is generated from 
a time function e(t) by sampling every T seconds, e(k) is understood to be e(kT) (i.e., the T is 
dropped for convenience). 

Three examples will now be given to illustrate the z-transform. 


EXAMPLE 2.1 


Given E(z) below, find {e(k)}. 
E) = 1+ 320) — 2? te 
We know, then, from (2-7), that the values of the number sequence {e(k)} are 
e(0O) = 1 e(3) = 0 
e(1) = 3 e(4) = 1 
e(2) = —2 


2.3 Transform Methods 


Consider now the identity 


i =ltxtxr ++, |x| <1 (2-10) 
=y 


This power series is useful, in some cases, in expressing E(z) in closed form, as will be illus- 
trated in the next two examples. 


EXAMPLE 2.2 


Given that e(k) = 1 for all k, find E(z). By definition E(z) is 
E@=1+z!+77+--: 


The closed form of E(z) is obtained from (2-10): 


EQ) = z= 2 jet) <4 (2-11) 
LZ B= G1 
Note that {e(k)} may be generated by sampling a unit step function. However, there are many 
other time functions that have a value of unity every T seconds, and thus all have the same 
z-transform. 
This same E(z) can be obtained using MATLAB as shown below. We also include the 
sampling interval T to illustrate that it has no impact on the result. 


>>syms k 
ek=1*k; 
Ez=ztrans (ek) 


EZ = 

z/(z - 1) 
>>syms k T 
ek=1* (k*T) ; 


Ez=ztrans (ek) 


EZ = 
z/(z = 1) 
EXAMPLE 2.3 


Given that e(k) = e “", find E(z). E(z) can be written in power series form as 
EG) Sal eg + ez? aes 


=1t (E77) + et Pt: 
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E(z) can be put in closed form by applying (2-10), so that 


1 z 
E(z) = a —;, e“Tz!| <1 
l-e aT, 1 z-e aT | | 


Note that, in this example, {e(k)} may be generated by sampling the function e() = e™. 
Again, this same E(z) can be obtained using MATLAB as follows: 


>>syms ka T 
ek=exp (-a*k*T) ; 
Ez=ztrans (ek) 


Ez = 
z/(z - exp(-a*T) ) 


As with the Laplace transform, each z-transform has a region of existence in the complex plane. 
This region is of importance if an integral is used to find the inverse z-transform [5]. However, if 
tables are used for both the forward transform and the inverse transform, the region of existence 
is not of direct importance. Hence we generally will not state the region of existence when a 
transform is employed. 


2.4 PROPERTIES OF THE z-TRANSFORM 


Several properties of the z-transform will now be developed. These properties will prove to be 
useful in the analysis of discrete-time systems. 


Addition and Subtraction 


PROPERTY. The z-transform of a sum of number sequences is equal to the sum of the 
z-transforms of the number sequences; that is, 


gle(k) = eD] = ER) + E) (2-12) 


Proof. From the definition of the z-transform, 


glei(k) £ ex] dle) + e(k]z* 


= deity" + 2e" = E,(z) + E,(z) 


Multiplication by a Constant 


PROPERTY. The z-transform of a number sequence multiplied by a constant is equal to the 
constant multiplied by the z-transform of the number sequence: 


glae(k)] = agle(k)] = aE(z) (2-13) 


2.4 Properties of the z-Transform 


Proof. From the definition of the z-transform, 


glae(k)] = X aek = aX ekz“ = aE) 
k=0 k=0 
Properties (2-12) and (2-13) form the linearity property of the z-transform. 


EXAMPLE 2.4 


The linearity property of the z-transform can also be proved as follows. Let 


e(k) = ae,(k) + be(k) 
Then 


gle(k)] = glaei(k) + ber(k)] 


= Slae(k) + bes(kylz * 
k=0 


=ade(kz* + b De(kz* 
k=0 k=0 


= agzle,(k)] + b3[e(k)] 
= aE\(z) + bE,(z) 


Real Translation 


PROPERTY. Letn be a positive integer, and let E(z) be the z-transform of {e(k)}. Then 


gle(k — n)u(k — n)] = z "E(z) (2-14) 
and 
n-1 
gle(k + n)u(k)] = z"| Elz) — X, elz (2-15) 
k=0 


The inversion integral in the z-transform definition (2-7) yields e(k) = 0 for all k < 0; 
hence, the z-transform of e(k) can be expressed as 


ale] = sle(kuck)] 


where u(k) is the discrete unit step function defined by 


k < 
u(k) = P 9 
1, k=0 


The time-delayed function in (2-14) is given by 
e(k — nyu(k — n) = e(hulk)| r-r- n 
In (2-15), advancing e(k) in time results in 


sle(kyu(k) |kr+n] = sle(k + nuk + n)] 
= gletk + n)u(k)] 
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TABLE 2-1 Examples of Shifting 


k e(k) e(k — 2) e(k + 2) 
0 2 0 1.3 

1 1.6 0 1.1 

2 1.3 2 1.0 

3 1.1 1.6 

4 1.0 1.3 


We now prove (2-14) and (2-15). 


Proof. From the definition of the z-transform, 


ale(k — iju — n)] = O + L O + eee) +--- 
= ¢"[e(0) + e(l)! + e(2)z* + +++] = 2" E(2) 


which proves (2-14). Also, 
gle(k + n)u(k)] = e(n) + e(n + Dz! + e(n + 2)z? fii 
By adding and subtracting terms and factoring z”, we obtain 


gle(k + n)u(k)] = z"[e(0) + ez! + e(2)z? +-+- + e(n — No? 
+ e(n)c® + e(n + Dot + e(n + Det +- 
— e(0) — e(1)z! = e(2)z —:-- -e(n- Dor? 
or 


n— 


1 
gle(k+ MuK] = z" EO) — X etz 
k=0 
which proves (2-15). 

To illustrate these properties further, consider the number sequence shown in Table 2-1, 
which illustrates the effects of shifting by two sample periods. For the sequence e(k — 2)u(k — 2), 
no numbers of the sequence e(k) are lost; thus the z-transform of e(k — 2)u(k — 2) canbe expressed 
as a simple function of E(z). However, in forming the sequence e(k + 2)u(k), the first two values 


of e(k) have been lost, and the z-transform of e(k + 2)u(k) cannot be expressed as a simple func- 
tion of E(z). 


EXAMPLE 2.5 


It was shown in Example 2.3 that 


2.4 Properties of the z-Transform 


Thus 


-ak-3T i(k — _ 3 K | = 1 
zle u[( 3)T]] =z - — aT Ze ET 


where u(kT) is the unit step. Also, 


gle Ot Tu [(kT) I] = il z 1 za 
z— 


We now define the discrete unit impulse function 5(k — n): 


1, k=n 


0, k#n re) 


se-m = 


This function is also called the unit sample function. The z-transform of the unit impulse function 
is then, forn = 0, 


glk — ny] = SSK -— ne* = (k — nz” = z” 
k=0 
from (2-16). 


Complex Translation 


PROPERTY. Given that the z-transform of e(k) is E(z). Then 


gle e(kT)] = Eee (2-17) 


Proof. From the definition of the z-transform, 


e(0) + ee(T)z! + e ez? + ++ 
= e(0) + eT T] + eE H 


zle e(kT)] 


or 
gle e(kT)] = E(z), eet = Elze") 


EXAMPLE 2.6 


Given that the z-transform of e(kT) = kT is E(z) = Tz/(z — 1, then the z-transform of kT “T 
is 
Tz 


ME 2 n 
zea (Z- D lze ze 


Tze 4 T Tet Tz 


(zea = 1) 7 (z == ely? 


E(z) 
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Again, this same E(z) can be obtained using MATLAB as follows: 


>>syms a k T 
ekT= (k*T) *exp (a*k*T) ; 
Ez=ztrans (ekT) 


EZ = 
(T*z*exp(T*a))/(z - exp(T*a))*2 


Initial Value 


PROPERTY. Given that the z-transform of e(k) is E(z). Then 
e(0) = lim E(z) 
Z— %0 
Proof. Since 
E(z) = e(0) + e)z! + e2)? +--+ 


then (2-18) is seen by inspection. 


Final Value 
PROPERTY. Given that the z-transform of e(k) is E(z). Then 
lim e(n) = lim (z — DEG) 
no z—> 
provided that the left-side limit exists. 
Proof. Consider the transform 


gle(k + 1) — e(k)] = lim | Sek + Dz * — He(kz* 
aa E E) k=0 


= lim [-e(0) + e) — zo) + eye! —- 2%) +: 


+ e(ni(z"*! — z”) + e(n + 1)z”] 


Thus 
lim [sle(k + 1) — eA) = lim [len + 1) — eO)] 


Also, from the real translation property, 
gle(k + 1) — e(k)] = z[E(z) — e(0)] — El) 


= (z — 1)E(z) — ze(0) 
Equating the two expressions above, we obtain 


dim, e(n) = jim, (z—-1) E(z) 


(2-18) 


provided that the left-side limit exists. It is shown in Chapter 7 that this limit exists provided that 


all poles of E(z) are inside the unit circle, except for possibly a simple pole at z = 1. 


2.5 Finding z-Transforms 


EXAMPLE 2.7 


To illustrate the initial-value property and the final-value property, consider the z-transform of 
e(k) = 1,k = 0,1,2,... . We have shown, in Example 2.2, that 


Z 
z=] 


EQ) = [1] = 


Applying the initial-value property, we see that 


e(0) = lim —— = lim 
ZO z z>% | 


z 


=1 
1/z 


Since the final value of e(k) exists, we may apply the final-value property: 


lim e() = lim œ — DEG) = lim (z vf Z )- lim z=1 
—> 00 z>1 z= 1 z— 1 21 


The derived properties of the z-transform are listed in Table 2-2, which also includes addi- 
tional properties. These additional properties are derived later, or else the derivations are given 
as problems. The notation e;(k)*e2(k) indicates convolution, and is discussed in Section 2.7. 


2.5 FINDING z-TRANSFORMS 


A table of z-transforms based on time sequences is given in Table 2-3. A more comprehen- 
sive table of z-transforms based on time-domain and Laplace-domain functions is given in 
Appendix VI. Note that the entries in Table 2-3 can be generated using MATLAB. 


TABLE 2-2 Properties of the z-Transform 


Sequence Transform 
k 2 
a BQ = Yee 
k=0 
aye\(k) + aek) aE\(z) + aE) 
elk — nuk — n); n=0 z "E(z) 
k+ k); 21 nl 
e(k + mulk); n elro- Sew 
k=0 
e“Te(k) Eze“) 
ke(k) __dEQR) 
zE 
e,(k) * ex(k) E)E) 
k ZEK 
e(k) = S en) Ez) = Zei. z 1*0 
n=0 


Initial value: e(0) = lim E(z) 


Final value: e(%) = lim (z — I)E(z), if e(~) exists 
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TABLE 2-3 z-Transforms 


Sequence Transform 
d(k — n) gen 
1 z 
gl 
k g 
z- 1 
k? zz + 1) 
gay 
ak z 
Za 
kak AE! 
z- a’ 
sin ak z sina 


z? — 2z cosa + 1 


cos ak z(z — cos a) 


z? — 2z cosa + 1 


a‘ sin bk az sin b 


z — 2az cosb + a? 


a‘ cos bk z? — az cos b 


z? — 2az cosb + a 


EXAMPLE 2.8 


In this example, we verify the last row in Table 2-3. We also include the sampling interval T to 
illustrate its impact on the result. 


>> syms a b k 
Ez = ztrans(a*k*cos (b*k) ) ; 
pretty(Ez) % Make it easier to read 


/ z \ 
z | cos(b) - - | 
\ a / 
/ 2 \ 
| z 2 z cos (b) | 
a |--- - ----------- + 1| 
| 2 a | 
\a / 


In Table 2-3, the sampling interval T is assumed to be 1. If T has some other value, the 
transforms must be altered appropriately. For the last line in the table, we now let T have an 
arbitrary value. 


2.5 Finding z-Transforms 


>> syms abkT 
ztrans (a^ (k*T) *cos (b*k*T) ) ; 


EZ = 
pretty (Ez) 
/ z \ 
z | cos(T b) - -- | 
T| 
\ a/ 
/ 2 \ 
T | z 2 z cos(T b) | 
a | ---- - ------------ +1 | 
2T T | 
\a a / 


Thus the relationship is 
z — a'zcos bT 


kT _ 
a“ cos bkT 
al l 2 — 2aľzcos bT + a?! 


In many digital control system design applications, system functions are conveniently 
expressed in the Laplace domain. Appendix VI may be used to find the z-transform of Laplace- 
domain functions. Using the Addition and Subtraction properties of z-transforms, one can first 
express a Laplace function in partial fraction form and then find the z-transform of each term. 


EXAMPLE 2.9 


' sot 4s +3 
Find the z-transform of E(s) = 3——,——— 
s + 6s + 8s 


First find the partial fractions expansion: 
S +4543 a sv +45 +3 


$ +6 + 85  s(s + 2)(s + 4) 


_ 0.375 0.25 a 0.375 
s s+2 s+4 


E(s) = 


Next find the z-transform of each term in the expansion: 


Zz g va 


E(z) = 0.375 
g= ER Z =E 
For T = 0.1, we can express E(z) as the ratio of two polynomials: 
Z Z Z 
E(z) = 0.375 0.025: + Ome 
— 1 z — 0.8187 z — 0.6703 


B= 1.6582? + 0.6804z 
2 — 2.4892? + 2.038z — 0.5488 


MATLAB may also be used to find the z-transform of E(s): 


saaTad 
num=[1 4 3]; 
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denom=[1 6 8 0]; % no repeated poles allowed 
n=length(denom) ; 
Es=tf (num, denom) 
[r,p,k] =residue (num, denom) ; 
fór isl: lin=1. 
pz (i) =exp (p (i) *T) ; 


end 
[numzz,denomz] =residue(r,pz,k) ; 
numz=conv(numzz,[1 0]); % multiply by z 


Ez=tf (numz,denomz,T) 


s^3 + 6 s^2 +85 


EZ = 
zZ*3 - 1.658 z*2 + 0.6804 z 


Z*3 - 2.489 z*2 + 2.038 z - 0.5488 


Note that the MATLAB ztrans function may also be used for this example by first finding e(t) 


and then finding E(z): 
>>T=0.1; 
syms st k z 
Es=(s^2+4*s+3)/(s^3+6*s^2+8*s); % As given 


et=ilaplace (Es); % Inverse Laplace to time domain 
ekT=subs (et,t,k*T); % substitute t=kT 


2 


Ez=ztrans(ekT); % Take the z-Transform 


2 


pretty(Ez) % Make it easier to read 


2.6 SOLUTION OF DIFFERENCE EQUATIONS 


There are three basic techniques for solving linear time-invariant difference equations. The first 
method, commonly referred to as the classical approach, consists of finding the complemen- 
tary and the particular parts of the solution [6], in a manner similar to that used in the classical 
solution of linear differential equations. This technique will not be discussed here; however, a 
technique similar to it is presented later in this chapter in the discussion of state variables. The 
second technique, which is a sequential procedure, is the method used in the digital-computer 
solution of difference equations and is illustrated by the following example. The third technique 
will be considered later. 


EXAMPLE 2.10 


It is desired to find m(k) for the equation 
mk) = e(k) — ek — 1) — mk — 1),k = 0 


2.6 Solution of Difference Equations 


where 


1, keven 
e(k) = 
0, kodd 


and both e(—1) and m(—1) are zero. Then m(k) can be determined by solving the difference 
equation first for k = 0, then for k = 1, k = 2, and so on. Thus 

m(0) = e(0) — e(-1) — m(-1) = 1-0-0=1 

m(1) = e(1) — e(0) — m0) =O0-1-1=-2 

m(2) = e(2) — e1) — m1) = 1-04+2=3 

m(3) = e(3) — e2) — m2) = 0- 1- 3 = —4 

m(4) = e(4) — e3) — mB) = 1- 0+4=5 


Note the sequential nature of the solution process in Example 2.10. Using this approach, we 
can find m(k) for any value of k. This technique is not practical, however, for large values of k, 
except when implemented on a digital computer. For the example above, a program segment, in 
MATLAB, which solves the equation for 0 = k = 20 is 


>>mkminusl = 
ekminus1 = 0; 
ek = 1; 
for k=0:20 
mk = ek - ekminusl - mkminus1; 
[k, mk] 
mkminus1 = mk; 
ekminus1 = ek; 
ek = 1 - ek; 
end 


0; 


In the coding, mkminus1 represents m(k — 1), mk represents m(k), ekminus1 represents e(k — 1), 
and ek represents e(k). The first three MATLAB statements initialize the sequential process, 
which begins with the fourth statement and extends to the last statement. A loop exists between 
the fourth and ninth statements and the first time through the loop mk = m(0), the second time 
through mk = m(1), and so on. 

The third technique for solving linear time-invariant difference equations, which employs 
the use of the z-transform, will now be presented. Consider the following nth-order difference 
equation, where it is assumed that {e(k)} is known. 


mk) + a,-ym(k — 1) + +++ + agm(k — n) 


(2-19) 
= belk) + bp jelk — 1) +++ + byelk — n) 


The z-transform of (2-19), which results from the use of the real translation property (2-14), is 


M(z) + a,- M) + +++ + agz"M(z) 


= b,E(z) + b,- E@) +: + boz EQ) (2-20) 


Note that the z-transform has changed the difference equation in (2-19) to the algebraic equation 
in (2-20). Solving the expression above for M(z) yields 


b, + baiz +e + boz” 
1+ an-z ! Pesag 


M(z) = EQ) (2-21) 
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m(k) can be found by taking the inverse z-transform of (2-21). General techniques for determin- 
ing the inverse z-transform are discussed in the next section. 


EXAMPLE 2.11 


Consider the difference equation of Example 2.10. 


m(k) = e(k) — ek — 1) — mk — 1) 


The z-transform of this equation, obtained via the real translation property, is 
MQ) = ER) — ZER) — 7 'MG@) 


or 
nmo = (4H) 
z aed Zz 
Since 
1, keven 
e(k) = 
0, kodd 
We see that 
1 z z? 
E(z =l+7?474*4+--- = —— — 
w Er 2-1 CDER 
Thus 


fer Zz = A 
no =-( ene ari 


We can expand M(z) into a power series by dividing the numerator of M(z) by its denominator 
so as to obtain 


Pie De ase A i 
P+2+1)2 


Z+ 2z+1 
= 2z] 
ee rat eae oe 
3 + 2z! 
3+ 6z! + 3z? 


— 4z! — 377 


(We discuss this method for finding the inverse transform in the next section.) Therefore, 


M@ = 1 — 2! +37? -47° +... 


2.7 The Inverse z-Transform 


and the values of m(k) are seen to be the same as those found using the sequential technique in 
Example 2.10. 


Thus far we have considered only difference equations for which the initial conditions are 
zero. The solution presented in (2-21) represents only the forced part of the response. In order to 
include initial conditions in the solution of (2-19), k is replaced with k + n. Then 


mk + n) + a,-ym(k +n — 1) +--+ + agm(k) 


(2-22) 
= b, elk + n) + belk +n — 1) +--+ + blk) 
From the real translation property (2-15), 
slink + D] = ZIME) — mO — mz +++ = mG De] (2-23) 


Thus the z-transform of (2-22) can be found using (2-23), and all initial conditions are included 
in the solution. Note that if all initial conditions are zero, the z-transform of (2-22) yields the 
same results as given in (2-21). Note also that for the nth-order difference equation (2-22), the 
initial conditions are, from (2-23), m(O), m(1), ... , m(n — 1). Thus the term initial conditions 
has a different meaning than for a differential equation. 


2.7 THE INVERSE z-TRANSFORM 


In order for the z-transform technique to be a feasible approach in the solution of difference 
equations, methods for determining the inverse z-transform are required. Four such methods will 
be given here. 


Power Series Method 


The power series method for finding the inverse z-transform of a function E(z), which is 
expressed as the ratio of two polynomials in z, involves dividing the denominator of E(z) into the 
numerator such that a power series of the form 


E(z) = eo + ez! + ez” +e’ (2-24) 


is obtained. From the definition of the z-transform, it can be seen that the values of {e(k)} 
are simply the coefficients in the power series. This technique was illustrated in Example 2.11. 
Another example will now be given. 


EXAMPLE 2.12 


It is desired to find the values of e(k) for E(z) given by the expression 


Z 


E@) = — 
ae Se area 
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Using long division, we obtain 


cit 3¢2 4+ 773 + 1574+- 


2-32+2) Z 
z=- 3+2! 
3-277! 
3 — 9z! + 6z? 
7z! — 6z” 


Iz! — 217? + 147° 
157? — 147° +... 


and therefore 


e(0)= 0 e(4)= 15 


e1) = 1 
e2)=3 ek) =2*-1 
e(3) = 7 


In this particular case, the general expression for e(k) as a function of k [i.e., e(k) = ok — 1] 
can be recognized. In general, this cannot be done using the power series method. 


Partial-Fraction Expansion Method 


In a manner similar to that employed with the Laplace transform, a function E(z) can be 
expanded in partial fractions and then tables of known z-transform pairs can be used to deter- 
mine the inverse z-transform. The z-transform pairs given in Table 2-3 and in Appendix VI can 
assist in these transformations. Before proceeding with an example of the partial-fraction expan- 
sion method, consider the function 


Egy = aha ee ea he (2-25) 


Examination of the power series indicates that 


F $ | = œ (2-26) 
Za 


where 3 ![+] indicates the inverse z-transform. This particular function is perhaps the most 
common z-transform encountered, since the sequence {a“} is exponential in nature (see 
Problem 2.3-2). 

It is seen from the transform table in Appendix VI that a factor of z appears in the numera- 
tor of the transforms given. Hence the partial-fraction expansion should be performed on E(z)/z, 
which will result in the terms of E(z) being of the same form as those in the tables. 


2.7 The Inverse z-Transform 


EXAMPLE 2.13 


Consider the function F(z) given in Example 2.12: 


Z 


MAR ENEA 


Hence 
Ez) _ 1 ap ere 
Z CA D Ca z-1 72-2 


F eee EE a 2 
3 EOQ] = 3 Ea t3 =] 


From (2-26) or Table 2-3, the value of e(k) is given by 
e(k) = —1 + 2% 
which is the same value as that found in Example 2.12. 
We can employ MATLAB to perform this same transformation: 


Then 


>>syms k z; 
Ez=z/((z-1)*(z-2)); 
iztrans (Ez,k) 


ans = 
2*k - 1 


Consider next the function 
1 
-= 1) 2) 
From the real translation property (2-14), e;(k) is given by 
ek) = J'R EGI] = ek — Dulk - 1) 
= [-1 + 2% D]u(k — 1) 


fo k=0 
© \=1 +200, k21 


This inverse can also be found by partial-fraction expansion. 


ED _ 1 | 


E\(z) = z'E(z) = 


NI- 


==+ + 
Z az—-1(z-2) zZz z=L 2-2 
or, () 
1 =z 3)z 
EZ) == + + 
1@) 2 Zr B= 2 
Thus 
elk) =a—1+ G)2*=a-14+ QQ)! 
where 


i k=0 
a = 
0, k=1 
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1 1 l k=0 
=| = tw = f? 
nfi] z O 0 EEA 


since from Table 2-3, 


Hence the two procedures yield the same results for e;(k). 
Again, we can employ MATLAB to perform the same transformation: 
>>syms k z; 


Elz=1/((z-1)*(z-2)); 
iztrans (E1z,k) 


ans = 
2*k/2 + kroneckerDelta(k, 0)/2 - 1 


Thus far we have considered the inverse z-transform by partial fractions only for functions 
that have real poles. The same partial-fraction procedure applies for complex poles; however, the 
resulting inverse transform contains complex functions. Of course, the sum of these functions is 
real. We now develop a different procedure that expresses the inverse transforms as real functions. 


First, consider the real function 


Aer 
y(k) = Ae“? cos (bkT + 0) = 


fe JbkKTojð 4. gibkT -jO 
A] (aT+jbT)ko jo (aT-jbT )ko -jð 

= —| € J g7 + € J € J 

2 

where a and b are real. Euler’s relation, given by 


eX +e” 
2 


cos x = 


is used in (2-27). The z-transform of this function, from Appendix VI, is given by 


A ez e?z 
Yke) = T+jbT T—jbT 
2Lz-—e"" z= e” 
(Ae? /2)z (Ae?/2z — kz % kiz 


+ ji =: = Ta k 
z= eat jbT z- eat jbT z Pi z- pi 


where the asterisk indicates the complex conjugate. 


(2-27) 


(2-28) 


The usual partial-fraction expansion yields terms in the form of (2-28). Hence, given the 
partial-fraction coefficient kı and the pole p, in (2-28), we can solve for the discrete-time func- 


tion of (2-27) using the following relationship from (2-28): 


pi = ee = ELT) > aT = hn |p; 


; bT = arg pı 
and 
Ae? A 
k =—— == 20 >A =2|k, 
2 2 


: 0 = arg kı 


(2-29) 


(2-30) 


2.7 The Inverse z-Transform 


Hence we calculate aT and bT from the poles, and A and @ from the partial-fraction expansion. 
We can then express the inverse transform as the sinusoid of (2-27). An illustrative example is 
given next. 


EXAMPLE 2.14 


We find the inverse z-transform of the function 


TE —3.8947 —3.894z 
T 2 + 0.6065 (z — j0.7788)\(z + j0.7788) 


kız Riz 
+ 
z — j0.7788 ` z + j0.7788 


Dividing both sides by z, we calculate kų: 


-3.894 
(< — j0.7788)(z + j0.7788) |;=; 0.7788 


k=- jars] 


—3.894 
z + j0.7788 


—3.894 
= ——— = 2.5290°. 
z=j0.7788 ~~ 2(0.7788) 


A MATLAB program that calculates these coefficients is given by 


>>num=[0,0,-3.894]; den=[1,0,.6065]; [r,p,k] =residue (num, den) 
F ieee — | 

O + 2.5001i 

O - 2.5001i 


O + 0.7788i 
O - 0.7788i 


Ee] 


The values of r are the residues (the partial-fraction expansion coefficients) for the correspond- 
ing poles p of Y(z), and k has values if the numerator of Y(z) is of higher order than the denomi- 
nator. From (2-29) and (2-30), with p) = j0.7788, 


aT = In|p,| = In(0.7788) = —0.250; bT = arg p,; = 7/2 
A = 2|k,| = 2(2.5) = 5; 0 = argk, = 7/2 
Hence, from (2-27), 


y(k) = Ae? cos (bkT + 8) 


= 5e 0" cos (Ze + z) = —5¢ 0k sin F 
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This result can be verified by finding the z-transform of this function using the table in 
Appendix VI. 


Inversion-Formula Method 


Perhaps the most general technique for obtaining the inverse of a z-transform is the inversion 
integral. This integral, derived via complex variable theory, is, from (2-7), 


e(k) = — $ E@z* ‘a, j= V-1 (2.31) 
r 


2Tj 


This expression is the line integral in the z-plane along the closed path I, where I is any 
path that encloses all the finite poles of E(z)z*"! [5,7]. 
Using the theorem of residues [7], we can evaluate the integral in (2-31) via the expression 


ek) = X, [residues of E(z)z*~'] (2-32) 
at poles 
of [E(2)z*"] 


If the function E(z)z‘! has a simple pole at z = a, the residue is evaluated as 
(residue),-, = (z — aE(z)z*"!|,=4 (2-33) 
For a pole of order m at z = a, the residue is calculated using the expression 


1 dq”! 


(m — Dt azn N a)" Ez" "| =a (2-34) 


(residue)... = 


EXAMPLE 2.15 


Consider the function E(z) from Examples 2.12 and 2.13: 


Z 


Ele) = 
K z= I- 2) 
Substituting this expression into (2-32) and (2-33) yields 
k zk 
=-1+ 2% 
ae z=2 


e(k) = 
(k) eas 


and the result is seen to be the same as that obtained in the previous examples. As in Example 2.13, 
let 
1 


E\(z) = zE) = =e >) 


Then, from the real translation property, 
ey(k) = e(k — Iu(k — 1) = [-1 + 2©° uk — 1) 


2.7 The Inverse z-Transform 
We can also find e,(k) by the inversion formula. In (2-32), 


z1 
AOTP TEA 
This function has a pole at z = 0 only for k = 0, and thus 
1 
e,(0) = aZ residual eee) TRD 
E E er 
2 2 


The values of e;(k) for k = 1 is obtained directly from (2-32), and is left as an exercise for 
the reader. 


The following example illustrates the inversion-formula technique for a multiple-order 
pole. 


EXAMPLE 2.16 


The function E(z) below has a single pole of order 2 at z = 1. 


_ Z 
E(z) = Q- I7 BETY 


The inverse transform obtained using (2-34) is 


= 1 a ( Z ) Z| 
eD = yt a fe Neate We 


Using MATLAB to perform this same inverse z-transform: 


>>syms k z; 
Ez=z/(z-1)^2; 
iztrans (Ez,k) 


ans = 
k 


Discrete Convolution 


The discrete convolution technique used for determining the inverse z-transform is analogous to 
the convolution integral employed in the use of Laplace transforms. Suppose that the function 
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E(z) can be expressed as the product of two functions, each of which, in general, will be simpler 
than E(z); that is, 


EQ) = E)E) (2-35) 
Further, let Æ; (z) and E2(z) be expressed as power series. Then 


E(z) = [e(0) + e)z! + e (2z? + +- Jie(0) + ex(1)z 


feor as] ji 
Direct multiplication of the two power series yields 
E(z) = e,(0ex(0) + [e,(0)ex(1) + e(Den(O)]z! (2-37) 
+ [e(O)ex(2) + e(Dex(L) + e1(2)e (Oz? +- - 
Thus the general relationship for e(k) is seen to be 
elk) = e\(O)er(k) + ei(1)ex(k — 1) + +++ + ei(k)e:(0) 
k k 
= Beek- n) = Dek — nen) (2-38) 


Equation (2-38) is the discrete convolution summation, and may be useful in determining the 
inverse z-transform of a function E(z) = E,(z)E>(z) if E\(z) and E>(z) are initially expressed as 
power series. Convolution is usually denoted as 


elk) = 5 '[E\(z)Ex(z)] = ex(k)*en(k) (2-39) 


EXAMPLE 2.17 


Once again consider the function E(z) from Example 2.12: 


— Z = 
E(z) = G-DE-D EDE) 


where we define 


Z z Z 
BQ) = alte tei te 


and 


1 
Ez) = reat Fe zi +272 + (2/3 H 


These expansions are obtained by the power-series method. Then e(k) can be formed 
directly from (2-38). For example, e(3) is given by the expression 


2.8 Simulation Diagrams and Flow Graphs 


3 
e(3) = Derm erl3 =n) 


= e,(0)e(3) + e,(1)ex(2) + e1(2)eo1) + e1(3)e2(0) 
= (DA + (2) + DO + (0) = 7 


The other values of e(k) can be obtained in a similar manner and a quick check of them will 
show that they agree with the values obtained via the other inversion techniques. A MATLAB 
program that performs a discrete convolution for this example is given by 

SS ed. = [1 4. ae ay ay 


e2 = [012 4 8 16]; 
e = conv(el,e2) 


e = 
Or de 37 AS BL 


This program correctly gives only the first six values of e(k). 


2.8 SIMULATION DIAGRAMS AND FLOW GRAPHS 


It has been shown that a linear time-variant discrete-time system may be represented by either a 
difference equation or a transfer function. A third representation commonly used is a simulation 
diagram (sometimes called a block diagram). Simulation diagrams for discrete-time systems are 
presented in this section. 

First the basic elements used to construct simulation diagrams for a system described by 
a linear difference equation are developed. Let the block shown in Fig. 2-2(a) represent a shift 
register. Every T seconds, a number is shifted into the register, and at that instant, the number 
that was stored there is shifted out of the register. Therefore, if we let e(k) represent the number 
shifted into the register at t = kT, the number shifted out of the register is e(k — 1). We let the 
symbolic representation of this memory device be as shown in Fig. 2-2(b). This symbol can rep- 
resent any device that performs the foregoing operation. 

An interconnection of these devices, together with devices that perform multiplication by 
a constant and summation, can be used to represent a linear time-invariant difference equation. 
For example, consider the difference equation used in Example 2.10: 


mk) = e(k) — e(k — 1) — m(k — 1) (2-40) 


A simulation diagram of this equation is shown in Fig. 2-3; writing the equation for the output of 
the summing junction yields (2-40). 


Shift 
register 


e(k) e(k—1) e(k) e(k—1) 


(a) (b) 
FIGURE 2-2 Ideal time-delay element. 
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e(k) e(k— 1) 


T m(k) 
O 


sf. p | m(k) m(k — 1) 
F 


FIGURE 2-3 Simulation diagram for the difference equation used in Example 2.10. 


Electronic devices may be constructed to perform all the operations shown in the figure. 
Now suppose that such a construction exists. Then to solve Example 2.10 using this constructed 
machine, the numbers in both memory locations (shift registers) are set to zero and the input 
e(kT) is made equal to | at time instants kT = 0, 2T, 4T, . . . and e(kT ) is made equal to 0 at time 
instants kT = T,37,5T,....The solution m(k) then appears at the output terminal at t = kT. 
(The reader may calculate the first few values of m(k) to illustrate the validity of the simula- 
tion diagram.) This machine would be a special-purpose computer, capable of solving only the 
difference equation (2-40). Recall that the computer program given below Example 2.10 also 
solves this difference equation, but in this case a general-purpose computer is used. The general- 
purpose computer software arranges the arithmetic registers, memory, and so on, to perform the 
operations depicted in Fig. 2-3. 

To include nonzero initial conditions in our special-purpose computer described above, 
replace k with k + 1 in (2-40) 


m(k + 1) = ek + 1) — ek) — mk) 


and in Fig. 2-3. Then the value of e(0) is placed in the register, in Fig. 2-3, whose output is 
now e(k), and the value of m(0) is placed in the register whose output is now m(k). The input 
values e(1), e(2), ... are applied at the input terminal in Fig. 2-3, and the output values 
m(1), m(2), ... appear at the output terminal. 

Recall that in the analog simulation of continuous systems, the basic element is the integra- 
tor. In the simulation of discrete systems, the basic element is the time delay (or memory) of T 
seconds. 

A somewhat different but equivalent graphical representation of a difference equation is 
the signal flow graph. A block diagram, such as that illustrated in Fig. 2-3, is simply a graphi- 
cal representation of an equation, or a set of equations. The signal flow graph may also be used 
to graphically represent equations. The basic elements of a flow graph are the branches and the 
nodes. By definition, the signal out of a branch is equal to the branch gain (transfer function) 
times the signal into the branch. This is illustrated in Fig. 2-4, which shows both the block dia- 
gram representation and the flow graph representation of a branch. Also, by definition, the signal 
at a node in a flow graph is equal to sum of the signals from all branches into that node. This 
is also shown in Fig. 2-4. Thus a flow graph contains exactly the same information as a block 
diagram. 

Once again, consider the time-delay device shown in Fig. 2-2(b). The z-transform of the 
input e(k) is E(z), and the z-transform of the output e(k — 1) is z | E(z). Thus the transfer function 


2.8 Simulation Diagrams and Flow Graphs 


E M E G M 
eeji G » <=> oO > O 
R + E R 1 E 
<=> O— 
— C C 


(a) (b) 
FIGURE 2-4 Equivalent block diagram (a) and flow graph (b) symbols. 


of the time delay is z '. (Recall that the transfer function of an integrator is s™!.) Consider again 
the system shown in Fig. 2-3. A flow graph representation of this system is as shown in Fig. 2-5. 
The transfer function of this system may be obtained either from Fig. 2-3 by block diagram 
reduction or from Fig. 2-5 by using Mason’s gain formula. Those readers unfamiliar with 
Mason’s gain-formula technique are referred to Appendix II. Basically, the gain formula is based 
on the geometry and signal flow directions of a flow graph. Since this architecture is exactly the 
same as that used in a block diagram, Mason’s gain formula may also be applied directly to a 
block diagram. 
The application of Mason’s gain formula to Fig. 2-5 yields the transfer function 


Mg). b—g* z-l1 
Ez) 1+z! <z+1 


which is the same as that obtained in Example 2.11. 
Consider now a general nth-order difference equation: 


mk) + a,—ym(k — 1) + +++ + agm(k — n) 


(2-41) 
= belk) + by_je(k — 1) + +++ + belk — n) 
Taking the z-transform of this equation yields 
MG) + an7 ME) + +++ + agz"M@) (2-42) 
= BER) + br- EO + +++ + boz EQ) 
This difference equation may then be represented by the transfer function 
M(z) b, + biz! +e + bg” 
(COR 1 0 (2-43) 


E(z) 1+ az! +: + az” 


E(z) 


FIGURE 2-5 Signal flow graph for the system shown in Fig. 2-3. 


61 


62 Chapter 2 ° Discrete-Time Systems and the z-Transform 


elk) e(k-1) e(k-2) e(k—n) m(k) 
oO @ T 1 


m(k) m(k-1) m(k-2) m(k—n) 
hd T =- 


o—e T e ---- = -| 


ag 


(b) 
FIGURE 2-6 (a) Simulation diagram for an nth-order difference equation; (b) flow graph for an nth-order 
difference equation. 


The system of (2-41) may be represented by the simulation diagram shown in Fig. 2-6(a), 
since the signal out of the summing junction satisfies (2-41). The flow graph for this diagram 
is shown in Fig. 2-6(b). Application of Mason’s gain formula to this flow graph yields (2-43). 

The simulation diagram of Fig. 2-6 is only one of many that can be constructed to repre- 
sent the transfer function of (2-43). The representation of Fig. 2-6 (and the example of Fig. 2-3) 
is non-minimal in the sense that the diagram contains 2n delays, but an nth-order system can be 
represented with only n delays. A minimal representation of the system of Fig. 2-3 is given in 
Fig. 2-7. This representation may be verified by calculating the transfer function via Mason’ s 
gain formula. This brings us to the topic of state variables for discrete systems, which is closely 
related to simulation diagrams. The remainder of this chapter is devoted to the topic of state 
variables. 


e(k) 4 T m(k) 


FIGURE 2-7 A different simulation diagram for Example 2.10. 
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2.9 STATE VARIABLES 


In preceding sections we defined a discrete-time system as one that can be described by a differ- 
ence equation. If the discrete-time system is linear and time invariant, we can also represent the 
system by a transfer function. For a linear time-invariant discrete-time system with input F(z), 
output M(z), and transfer function G(z), we can write 


M(z) = G(z)E(z) (2-44) 


as illustrated in Section 2.8. Thus the discrete-time system may be represented by the block dia- 
gram of Fig. 2-8(a). 

The more modern approach to the analysis and synthesis of discrete-time systems employs 
what is commonly called the state-variable method. In this approach the system is modeled as 
shown in Fig. 2-8(b). To be completely general, we must allow for the possibility of more than 


one input, and of more than one output. Thus, in Fig. 2-8(b), the variables uk), i = 1,...,7, are 
the external inputs which drive the system; the variables y,(k), i = 1,...,p, represent the system 
outputs or the system responses; and the variables x(k), i = 1,...,, are the internal or state 


variables of the system. The state variables represent the minimum amount of information which 
is necessary to determine both the future states and the system outputs for given input functions; 
that is, given the system states, the system dynamics and the input functions, we can determine 
all subsequent states and outputs. 

For convenience we represent the system shown in Fig. 2-8(b) by that shown in Fig. 2-8(c), 
where u(k) is the input vector, y(k) is the output vector, and x(k) is the state vector: 


u(k) yik) x(k) 
= n — vat Le a 
u,(k) yk) x(k) 


The set of values that the input vector u(k) may assume is called the input space of the 
system. The output space and state space are defined in a similar manner. 


ER) ——] G(Z) m~ Me) 


uk) ————>| State | > yk 
variables 
ulk ———*| xab [| _ yolk) 
x(k) 
uk — n k yk) u(k) ————>| n c yk) 
x 
(b) (c) 


FIGURE 2-8 Representations of system dynamics: (a) z-transfer function representation; (b) state- 
variable representation; (c) state-vector representation. 
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In general, the equation that describes the state of the system at any time (k + 1) is given 
by the single-valued function relationship 


x(k + 1) = f[x(k), u(h)] (2-45) 


This equation simply states that the state x at time (k + 1) is a function of the state and the input 
at the previous discrete-time increment k. The output response of the system is defined in a simi- 
lar manner as 


y(k) = g[x(k), uk] (2-46) 


As stated earlier, when we say time k, we actually mean time kT. 
If the system is linear, then equations (2-45) and (2-46) reduce to 


x(k + 1) = A(k)x(k) + Bulk) (2-47) 


y(k) = C(A)x(k) + Dulk) (2-48) 


where x(k) is an n-vector, u(k) is an r-vector, y(k) is a p-vector (as shown in Fig. 2-8), and 
A(k), B(x), C(k), and D(x) are time-varying matrices of dimensionsn X n,n X r, p X n,and 
p X r, respectively. If the system is time invariant, then the matrices in (2-47) and (2-48) are 
constant, and hence the equations reduce to 


x(k + 1) = Ax(k) + Bu(k) (2-49) 


y(k) = Cx(k) + Du(k) (2-50) 


(See Appendix IV for a review of matrices.) State-variable modeling will now be illus- 
trated by an example. 


EXAMPLE 2.18 


It is desired to find a state-variable model of the system described by the difference equation 
yk + 2) = uk) + 1.7y(k + 1) — 0.72y(k) 


Let 


x(k) = yk) 
x(k) = x(k + 1) = wk + 1) 


Then 


x(k + 1) = yk + 2) = ulk) + 1.7k) — 0.72x,(k) 


or, from these equations, we write 


2.9 State Variables 


x(k + 1) = x(k) 
x(k + 1) = —0.72x,(k) + 1.7x(k) + ulk) 


yk) = x(k) 
We may express these equations in vector-matrix form of (2-49) and (2-50) as 


0 1 0 
x(k + 1) = ee BEG + | Shw 


y(k) = [1 0]xk) 


Equations (2-49) and (2-50) are the state equations for a linear time-invariant system and usually 
represent the starting point in the analysis or design of a discrete system by modern methods. 
However, let us first examine the connection between this approach and the z-transform method. 
To do this we will give one method for deriving a set of discrete state-variable equations from 
the z-transform transfer function. 

Given the transfer function 


bei + b az ie +f biz + bo 
z! + az! +- + az t+ ao 


Gz) = (2-51) 


in which we have assumed that the order of the numerator is less than that of the denominator. 
We can write (2-51) as 


Y(z b 1z! + b2? +: + biz + Do EZ 
(Zz) _ GO) = K Be 1 o E(z) (2-52) 
U(z) z” + an- +t tazta EK) 
where the auxiliary variable E(z) has been introduced. We now let 
¥(z) = ba kaaa + +++ + bz + b)E@) (2-53) 
UG) = @" + ay"! +++ + az + a)E@) (2-54) 
Recall from the real translation property the correspondence 
E(z) > elk) 
ZE(z) > e(k + 1) 
ZEZ) > e(k + 2) 
Under this correspondence we define the state variables 
x(k) = elk) 
x(k) = x(k + 1) = e(k + 1) 
x(k) = x(k + 1) = e(k + 2) (2-55) 


aE = yak + 1) = ek +n- 1) 
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From equations (2-54) and (2-55) we obtain the state equations 


x(k + 1) = x(k) 
x(k + 1) = x(k) 
x(k + 1) = x(k) (2-56) 


x(k + 1) = —apxi(k) — a(k) — ax) — -+ — an- 1X,(k) + uh) 


which written in matrix form is 


x(k + 1) 0 1 0 0 Qo ats 0 x(k) 0 
x(k + 1) 0 0 1 0 O oc 0 x(k) 0 
=| 0 0 0 1 0 0 +} + fulk) 
: 0 
(e+ 1) a a a ee ee | ee l 
(2-57) 
or simply 
x(k + 1) = Ax(k) + Bulk) (2-58) 
The output equation obtained from (2-53) is 
x(k) 
x(k) 
yk) = [bo b a A (2-59) 
XO 
or simply 
y(k) = Cx(k) (2-60) 


Hence equations (2-58) and (2-60) are a set of state equations for the discrete-time system 
described by equation (2-51). 

Another convenient and useful representation of the discrete system is the signal flow graph 
or the equivalent simulation diagram. These two forms can be derived from equation (2-52) 


O Ye) _ baaz! + baz” +e + By!" + boz” EQ) 


G(z 2-61 
@) U(z) lta zi te: ta" + az" EQ ( ) 

From this expression we obtain the two equations 
Ye) = (bya + Bye? +s ebi A boz MER) (2-62) 


Uz) = (1 + an-z! +- + az + aoz ")E(z) (2-63) 


Equation (2-63) can be written as 


2.9 State Variables 


E(z) = U(2) — aZ EZ) — +++ — ajz! "E(Z) — aoz "E(2) (2-64) 


A signal flow graph representation of the system described by equation (2-51) can be eas- 
ily derived from equations (2-62) and (2-64) and is shown in Fig. 2-9(a). 


UZ) 1 
oO a 
ba 
A 
u(k) y a ll iy 


Tan- 


—a; |æ 


yk) 


xik 


x(k) 


ay la 


(b) 


FIGURE 2-9 Equivalent control canonical form (or phase variable canonical form) representations of 


equation (2-51): (a) signal flow graph representation; (b) simulation diagram. 
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u(k) 


bo bı bn- 


o— 
7 


FIGURE 2-10 Observer canonical form. 


y(k) 
T eiee O = T = 
+ 


Recall that the transfer function for a pure delay of T seconds is z ', where T is the 


discrete-time increment (i.e., T is the interval between sampling instants k, k + 1, k + 2, etc.). 
Using this relationship, the signal flow graph of Fig. 2-9(a) can be immediately converted to the 
equivalent simulation diagram of Fig. 2-9(b). We see from (2-57) and (2-59) that the states are 
the register outputs, as noted in Fig. 2-9(b). 

Note the relationships that exist between equations (2-57) and (2-59) and the diagrams in 
Fig. 2-9. One who is very familiar with the correspondence between the equations and diagrams 
can derive a flow graph or simulation diagram from the transfer function by inspection. From 
the flow graph, one may use Mason’s gain formula to reconstruct the original transfer function. 
The structure of Fig. 2-9, together with equations (2-57) and (2-59), is called either the control 
canonical form or the phase variable canonical form, and is useful in the design procedures pre- 
sented in Chapters 9 and 11. 

Another standard form that is useful in the design procedures of Chapter 9 is the observer 
canonical form, which is illustrated in Fig. 2-10. Note, using Mason’s gain formula, that the 
transfer function for Fig. 2-10 is (2-61). It is left as an exercise for the reader to write the state 
equations for the observer canonical form (see Problem 2.9-2). 


EXAMPLE 2.19 


Given the following function, we want to derive a signal flow graph and corresponding state 
equations: 


Yq zŻ+2z+1 
U(z) 2+2 +z+:ł 


G(z) = 


Comparing this expression with (2-51) and Fig. 2-9(a) indicates that the signal flow graph 
can be derived by inspection, as shown in Fig. 2-11. Note that the states are then chosen to be 
the delay outputs. The state equations can now be derived from Fig. 2-11 or from a comparison 


2.9 State Variables 


Y(z) 


FIGURE 2-11 Flow graph for Example 2.19. 


of the given transfer function with equations (2-51), (2-57), and (2-59). The resulting state 
equations are 


x(k + 1) 0 1 O]fx® 0 
x(k +1} =] 0 0 1] | x(k) | +] 0 luce) 
x(k + 1) -4 -1 -2] Lay(k) 1 
x(k) 
y(k) = [1 2 1x2% 
x(k) 


The following example will demonstrate an important salient feature encountered in going 
from the transfer function to the state equations. 


EXAMPLE 2.20 


Given the following transfer function, we wish to derive the state equations: 


YD bye? +bz+b 
U(z) z? + az + a 


In this case, the order of the numerator is equal to that of the denominator. First we express the 
transfer function as 


¥(z) _ by + byz | + boz? EQ) 
U(z) 1 +az! + az” EQ) 


We see from Mason’s gain formula that the signal flow graph for this transfer function is as 
shown in Fig. 2-12. The states are shown on the flow graph, and the equations are seen to be 
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Y(z) 


FIGURE 2-12 Flow graph for Example 2.20. 


k+1 0 1 k 0 
[eto] l-a -adael * Lr} 
x(k F 1) —ado =a x(k) 1 
At this point it is important to note that the flow graph in Fig. 2-12 is slightly different from the 


form presented earlier; that is, there is a direct path from E(z) to Y(z). From the flow graph the 
equation for the output is 


Y(z) = DX) + bX) + bE) 
But 
EQ) = UR) = aX) = aXQ) 
From these equations we obtain 
Y(z) = b,U(Z) + (bo — bzao)X1Q) + (b; — bya)X2(Z) 
Hence the output equation is 
x(k) 


a + bulk) 


y(k) = [(bo — bza) (bi — bya) 


Note the difference in this equation and (2-59). 


Whenever the numerator and denominator of the transfer function are of the same order, 
the output state equation must be handled as demonstrated above. Also, the output equation may 
be written by inspection from Fig. 2-12. 


EXAMPLE 2.21 


We wish to derive the state equations for the multivariable discrete-time system shown in 
Fig. 2-13. The state equation can be obtained directly from the simulation diagram by inspection. 


F + D) 7 Ihe Aled : f: e 
w(ktD} li Ila 0 LIL w(k) 


E + Tse 
yo(k) O TIL x(k) O 1 JLu(k) 


2.10 Other State-Variable Formulations 


u,(k) + x(k) + y,(k) 
| T T = 


Uy(k) 


FIGURE 2-13 Simulation diagram for a multivariable system. 


In summary, state models may be derived from transfer functions by the procedure illus- 
trated in (2-52) through (2-59). A second procedure is: 


1. Draw a simulation diagram of the system, using any convenient method. 

2. Assign a state variable to each delay output. 

3. Write the equation for each delay input and each system output in terms of only the delay 
outputs and the system input. 


The system transfer function gives an input—output description of the system, while the state 
model gives an internal description in addition to the input—output description. The transfer func- 
tion for a given system is unique, while the internal model (state model) is not. 


2.10 OTHER STATE-VARIABLE FORMULATIONS 


We have seen in the preceding section the techniques for finding a state-variable formulation for 
a single-input, single-output discrete-time system, given either the system difference equation or 
the system transfer function. For a given system, there is no unique state-variable formulation. 
For a given transfer function, any simulation diagram with the system transfer function yields 
a valid state-variable model for the system. However, for certain analysis or design procedures, 
certain formulations present advantages with respect to calculations, as will be shown in later 
chapters. The following example illustrates some derivations of different formulations. 


EXAMPLE 2.22 


Consider the difference equation of Example 2.18: 


y(k + 2) = ulk) + 1.7y (k + 1) — 0.72y (k) 
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One state-variable model was derived in that example. Two additional models are derived here. 
Taking the z-transform of the difference equation yields 


Y(z) E 1 
UZ) z2 — 1.7z + 0.72 


This transfer function can be expressed as 


o ee 
U(z) z — 0.9J}Lz — 0.8 


A simulation diagram for this transfer function is given in Fig. 2-14(a). From this figure we write 
the state equations 


0.8 1 
0 0.9 
yk) = [1 O]x(k) 
Also, the system transfer function can be expressed, through partial-fraction expansion, as 
Yz) __—s«(10 i —10 
Uz) z-09 z-0.8 


x(k + 1) = | kw + [huw 


x(k) 


u(k) xk) g 
m S K= 


+ | + yk) 
09 ja 0.8 


x(k) 
T 10 


A) 
0.9 je 


x(k) 


7 
0.8 


(b) 
FIGURE 2-14 Simulation diagrams for Example 2.22. 


Ny 


2.10 Other State-Variable Formulations 


A simulation diagram for this transfer function is given in Fig. 2-14(b). From this figure we write 
the state equations 
0.9 0 


1 
0 kw + [hw 


et y= | 


yk) = [10 —10]x(k) 


In Example 2.22, we first represented a higher-order transfer function as a product of sim- 
pler transfer functions. For the general case, we would express the transfer function G(z) as 


GZ) = G ()G2,Z) Gn Q) (2-65) 


Each of the simpler transfer functions G; (z) is realized by a technique of the preceding section, 
and the realizations are then connected in cascade to realize G(z). If G(z) contains either complex 
poles or complex zeros, we may choose some of the G; (z) in (2-65) to be second order, to avoid 
computational difficulties with complex elements in the state-variable matrices. 

Next, in Example 2.22, we represented a higher-order transfer function as the sum of 
simpler transfer functions through partial-fraction expansion. For the general case, we would 
express the transfer function G(z) as 


GQ) = GO + GOH + G) (2-66) 


Each of the simpler transfer functions G, (z) is realized by a technique of Section 2.9, and the 
realizations are then connected in parallel to realize G(z). 

We have just seen three methods for arriving at different state models for a discrete-time 
system, with these models derived from the system transfer function. In fact, we can derive any 
number of different state models, given one state model of the system, through similarity trans- 
formations. This procedure will now be developed. Consider the state equation in the form 


x(k + 1) = Ax(k) + Bu(k) 
y(k) = Cx(k) + Duk) (2-67) 
Now, we can apply the linear transformation 
x(k) = Pw(k) (2-68) 
that is, 
x(k) = prwilk) + prowrlk) ++ + Piw, 


and so on. Hence P is a constant (n X n) matrix and w(k) is the new state vector. Note that it is 
necessary that P|, the inverse of P, exists so that w(k) can be determined from x(k). Substituting 
(2-68) into (2-67) yields the equations 


wk + 1) = P'APW(k) + P7'Bu(k) 
y(k) = CPw(k) + Du(k) (2-69) 
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These equations can be expressed as 


wk + 1) = A, w(k) + B, u(k) 
y(k) = C, wk) + D,,u(k) (2-70) 


where 


A, = P'AP, B, =P |B 
C,, = CP, D, =D (2-71) 


Thus for each different P for which P~! exists, a different state model of a given system can be found. 
The characteristic equation of a matrix A is defined by the determinant [8] 


|I- A| =0 (2-72) 


and the characteristic values (or eigenvalues) of the matrix are the roots of the characteristic 
equation; that is, z; are the characteristic values of A if 


(A= Al = aE a) ES nO (2-73) 


It will be shown in Chapter 7 that (2-73) determines system stability for the system of (2-67). 
Note that the characteristic equation of the system matrix is unchanged through the linear 
transformation, 


|z- A,| = |z — P'AP| = |zP IP — P'AP| 
= |P'||z2Œ — A||P] 
|z — A| (2-74) 


A linear transformation of the form 
A, = P'AP (2-75) 


which is called a similarity transformation, has the following properties: 


1. As shown above, the characteristic values of the matrix are unchanged under the 
transformation. 

2. The determinant of A,, (which is the product of characteristic values) is equal to the deter- 
minant of A: 


|A,| = [PAP] = |P |JA||P|= [A] = azez, 
3. The trace of A,, is equal to the trace of A: 
tA, =tA = atza tZ 


since the trace of a matrix, which is the sum of the diagonal elements, is equal to the sum 
of its characteristic values. The latter property follows immediately from the first property. 
4. As is shown in Section 2.11, 


Cki- A] 'B te DSC lel = A.) 'B,, + D, 


2.10 Other State-Variable Formulations 
EXAMBPLE 2.23 


For the system of Example 2.22, one state-variable model is given as 


0.8 1 
0 0.9 


yk) = [1 Olx% 


We arbitrarily choose a linear-transformation matrix 


a 


x(k + 1) = | ko + P hw 


The inverse of P is given by 


p~ = [Cof [PJ]? 
|P| 
where [a indicates the transpose, and Cof [P] denotes the matrix of cofactors of P. 
Thus 
Cof [P] [i z 
(@) a. 
1 1 
and 
[P| = 2 
Then 
pa = 0.5 a 
—0.5 0.5 
Thus, from (2-71), 
[ 05 05]/08 1 1 -1 
verwees e E 
L-0.5 0.5] 0 0.9] L1 1 


f 05 le o2] | 1.35 | 
-0.5 05)109 0.9 —0.45 0.35 


Then the new state equations are 


_f 135 0.55 0.5 
tm Re 5s w i [o uw 
yk) = [1 —1]w(k) 


75 


76 


Chapter 2 ° Discrete-Time Systems and the z-Transform 
Note that 
z— 0.8 —1 

0 z— 0.9 


|I -A| = | = z2 — 1.7z + 0.72 = (z — 0.8)X(z — 0.9) 
and 
z= 135 —-0.55 


| <I - A,| = 
0.45 z — 0.35 


| = z2 — 1.7z + 0.72 


Hence the characteristic values are zı = 0.8 and z2 = 0.9. Also, 
|A| |A] 0.72 = zz 


and 
tA = rA, =17=5z +z 


The results of this example can be verified using MATLAB. 


MATLAB may be also used to find new state-space formulations using similarity trans- 
forms. Consider the third-order example below. 


EXAMPLE 2.24 


Given 


5z? + 10.5z + 5.8 


G — 
© 34112 + 052+ 012 


we can write the state matrices for the control canonical form by inspection using (2-57) and 
(2-59): 


0 1 0 0 
A= 0 0 1 B=|0 
0.12 0.5 1.1 1 


C= [5.8 105 5] 


Arbitrarily choosing matrix P 


3 8 4 
P=|0 7 5 
9 6 2 


Using MATLAB, we can verify that P has an inverse, and then find a new state-space formula- 
tion using matrix P in (2-71): 


>>A=[0 1 0;0 0 1;-.12 -.5 -1.1]; 


Belo 0 1] *3 
C=[5~8)10.5;5] 2 
D=0; 


P=[3 8 4;0 7 5;9 6 2]; 
invP=inv (P) 


2.10 Other State-Variable Formulations 


-0.2667 0.1333 0.2000 
0.7500 -0.5000 -0.2500 
-1.0500 0.9000 0.3500 


-0.8520 -3.2787 -2.1027 
-1.9350 5.0150 4.0450 
4.5090 -5.8210 -5.2630 


Cw = 
62.4000 149.9000 85.7000 


If a system has distinct characteristic values, we may derive a state-variable model in 
which the system matrix is diagonal. Consider a vector m; and a scalar z; defined by the equation 


Am; = zm; (2-76) 
where m; = [m;; m; *** mi]. We express (2-76) as 
(zA — A)m;= 0 
For a nontrivial solution for this equation to exist, it is required that 
|zI - A| =0 
Hence, from (2-72), it is seen that z; is a characteristic value (also called an eigenvalue) of A. The 


vector m; is called a characteristic vector, or eigenvector, of A. From (2-76) we can construct 
the equation 


Zi 0 s 0 
0 > 0 
Alm; m =: m]=[m m e mJ} | K Ti 
0 0 + 4 
or 
AM = MA 


where M, called the modal matrix, is composed of the characteristic vectors as columns, and A is 
a diagonal matrix with the characteristic values of A as the diagonal elements. The characteristic 
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vectors are linearly independent provided the characteristic values are distinct. Hence we can 
write 


A = M'AM (2-77) 


Then, in the general similarity transformation, P is equal to M, the modal matrix. An example 
will be given to illustrate this procedure. 


EXAMPLE 2.25 


For the system of Example 2.23 


0.8 1 0 
KkK+D= |) gg ®t] uw 


yk) = [1 O]x(k) 


From Example 2.23, the characteristic values are z} = 0.8 and z, = 0.9. From (2-76), 
0.8 1 
0° osm] = imm 
0 0.9 Mı M1 


0.8m, + mM = 0.8m; 
0.9m, F 0.8m, 


Thus 


Hence m, = 0 and m; is arbitrary. Let mıı = 1. Also, 


Pa 1 [e 2 oe] 
0 0.9 M2 Mz 


Then m, is seen to be arbitrary; let m = 1. Then mı = 10. The modal matrix and its inverse 


are 
M = Ke | a k d 
M1 mM (0) 1 
and 
TE k a 
(0) 1 
From (2-71) and (2-77), 
0.8 0 
A = M'AM = | | 
0 0.9 
—1 
B, =M'B = | y 


2.10 Other State-Variable Formulations 


Hence the new state model is given by 


0.8 0 —10 
wk + l= |. o wo + | uw 


yk) = [1 10] w(k) 


A MATLAB program that calculates the characteristic vectors and the characteristic values is 
given by 


>> A = [0.8 1; 0 0.9]; 
[M, LAMBDA] = eig(A) 

M = 

1.0000 0.9950 

0 0.0995 
LAMBDA = 

0.8000 0 

0 0.9000 


The matrix M gives the characteristic vectors as columns (each determined only within a con- 
stant factor), and LAMBDA gives the characteristic values on its diagonal. 


Now let us demonstrate using MATLAB to generate a new state-space representation in 
which A,, = A. 


EXAMPLE 2.26 


Given 
10z- 5 


G — 
@ 3-212 + 1.42 — 0.288 


we can write the state matrices for this function from (2-57): 


0 1 0 0 
A=] 0 0 1 B= | 0 
0.288 -14 2.1 1 


C=[-5 10 0] D= [0] 


Now we can employ MATLAB to compute (2-71) with P = M: 


>>A=[0 1 0;0 O 1;0.288 -1.4 2.1]; 
B=[0 0 1]'; 
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-0.9184 -0.6985 -0.6368 
-0.3674 -0.5588 -0.5731 
-0.1469 -0.4470 -0.5158 


0.4000 0.0000 0.0000 
0.0000 0.8000 0.0000 
0.0000 -0.0000 0.9000 


-5.4443 
35. TILT 
-31.4076 


Cw = 
0.9184 -2.0955 -2.5472 


Dw = 
0 


2.11 TRANSFER FUNCTIONS 


In the techniques described earlier in this text for obtaining a state-variable formulation, we 
derived the state model from the transfer function. In this section we demonstrate how one may 
obtain the transfer function, given the state model. 

As a first approach, given the state equations of a discrete-time system, we can construct 
a simulation diagram. The transfer function can then be obtained from the simulation diagram, 
using Mason’s gain formula. 


EXAMPLE 2.27 


Consider the state model derived in Example 2.23. 


1.35 0.55 
—0.45 0.35 


0.5 


0.5 l% 


x(k + 1) = | kw + | 


yk) = [1 —1]x(k) 


A simulation diagram, constructed from these equations, is shown in Fig. 2-15. 
Application of Mason’s gain formula to this figure yields 


¥@) _ 0.524 — 0.35274) — 0.5270 — 1.3577!) + (0.5)(0.45)z 2 + (0.5)(0.55)z 
U(z) 1 — 1.357! — 0.357! + (0.45)(0.55)z7 + (1.35z7!)(0.35z!) 


z? 1 


~ = 1728 + Onz z2- 1.72 + 0.72 


2.11 Transfer Functions 


0.45 ~—— 


wO f| $ y(k) 


0.55 — 
7 x(k) 
+ 
0.35 je— 


FIGURE 2-15 System for Example 2.27. 


Since this is the system transfer function, we see that the derived state model is valid. 


Another approach for obtaining the system transfer function from the state equations is to 
take the z-transform of the state equations and eliminate X(z). Since 


x(k + 1) = Ax(k) + Bu(k) (2-78) 
taking the z-transform yields 
zX(z) — zx(0) = AX(z) + BU(z) (2-79) 


Since, in deriving transfer functions, we ignore initial conditions, (2-79) can be expressed as 


LI — A]X(z) = BUC) (2-80) 
Solving for X(z), we obtain 
X(z) = [dl — A] 'BU(2) (2-81) 
Also, since 
y(k) = Cx(k) + Dulk) (2-82) 
then 


Y(z) = CX(z) + DU(z) (2-83) 
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Substituting (2-81) into (2-83) yields 
¥(z) = [C[al — AJ 'B + D]U() 
The system transfer function is then seen to be 
G(z) = CKI — AJ 'B + D 


This technique will now be illustrated by an example. 


EXAMPLE 2.28 


Consider again the state equations of Example 2.24. 


_[ 135 0.55 0.5 
AURAS E 5s x is [Oo hw 


yk) = [1 — I)x(k) 


Now 
a al=|* 135) 055 l 
7 0.45 z=-035 
Thus 
|z — A| = 2 — 1.7z + 0.72 
Also, 
z- 0.35  —0.45 
Cof[zI — A] = 
otek] | 055 z= A 
Then 
[I - AT = [Coffzl — A}? _ 1 i — 0.35 
|z — A| 2 — 1.72 + 0.72L —0.45 
From (2-84), since D = 0, 
G(z) = CI — A]7'B 
= 1 [1 j — 0.35 0.55 
z — 1.7z + 0.72 —0.45 z- 1.35 
= 1 fl i ie + a 
zZ — 1.7z + 0.72 0.5z — 0.9 


1 
Fee 0.72 


0.55 


z— 1.35 


= 
0.5 


| 


(2-84) 


This, of course, has been shown to be the transfer function. We can also perform the computa- 


tions of (2-84) in MATLAB; 


2.11 Transfer Functions 


>> syms z 


A = [1.35 0.55; -0.45 0.35]; 
B = [0.5; 0.5]; 

C = [1 -1]; 

Ps Uy 


Gz = C*inv(z*eye (2) -A) *B+D; 
simplify (Gz) 


50/((5*z - 4)*(10*z - 9)) 


% save this m-file 


function [nr2,dr2] = nice(old,z) 
NICE takes the original expression and makes it look nice 
Input: (a*z*2 + b*z + c)/(d*z*2 + e*z + f) 


Output: (al*z*2 + bl*z +c1)/(z*2 + el*z + f1) 
old contains symbol of z 

rearrange the expression to collect coefficients 
new = collect (old,z); 

% obtain the coefficients of numerator and denominator 

dr = fliplr(coeffs(feval (symengine, 'denom',new) )) ; 

nr = fliplr(coeffs(feval (symengine, 'numer',new) )) ; 

% normalize the coefficients with the coeff of dr z*2 term 
dr2 = double(dr/dr(1)); nr2 = double(nr/dr(1)); 

end 


AP W W A oN? 


>> [num, den] =nice (Gz,z); T=1; 
Gz=tf(num,den,T) % Requires a value for T 


which simplifies to the same result. MATLAB functions ss2tf and tf may also be employed as 
shown below to generate G(z) in reduced form: 


> A = [1.35 0.55; -0.45 0.35]; 


= 1; Sampling period should be specified 
num, denom] =ss2tf (A,B,C,D); 
Gz = tf(num, denom, T) 


> 

B [0 

C = [1 -1]; 
D 0 

T 

[ 


Another property of the similarity transformation, applied to state models as given in (2-70), 
is seen from the example above. Since the transfer function of a system is invariant under a simi- 
larity transformation, then, from (2-70) and (2-84), 


CkI — A] B + D = C,izI — A,]'B, + D, (2-85) 


The proof of this property is left as an exercise for the reader (see Problem 2.11-5). 
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In this section two techniques were presented for obtaining the transfer function from the 
state equations. For high-order systems, the second method is more attractive. 


2.12 SOLUTIONS OF THE STATE EQUATIONS 


In this section we develop the general solution of linear time-invariant state equations. It will 
be seen that the key to the solution of the state equations is the calculation of the state transi- 
tion matrix. Two related techniques, based on the z-transform, for calculating the state tran- 
sition matrix are presented. Then the solution of state equations via the digital computer is 
mentioned. 


Recursive Solution 


We will first assume that the system is time invariant (fixed) and that x(0) and u(j), 


j = 0,1, 2,... , are known. Now the system equations are 
x(k + 1) = Ax(k) + Bu(k) (2-86) 
y(k) = Cx(k) + Duk) (2-87) 


In a recursive manner it is obvious that 

x(1) = Ax(0) + Bu(0) 
and 

x(2) = Ax(1) + Bu(1) 
and hence 

x(2) = A(Ax(0) + Bu(O)) + Bu(1) 
= Ax(0) + ABu(0) + Bu(1) 
In a similar manner we can show that 
x(3) = A’x(0) + A’Bu(O) + ABu(1) + Bu(2) 


It is seen, then, that the general solution is given by 


k=l 
x(k) = Ax(0) + X A4 Buc j) (2-88) 
j=0 
If we define 
p(k) = Æ 
then 
k=l 
x(k) = O(k)x(0) + X Ok — 1 — )Bu( j) (2-89) 
j=0 


This equation is the general solution to (2-86). From (2-87) and (2-89), 


k-1 
y(k) = C@(K)x(0) + X CPK — 1 — {Bul j) + Dulk) (2-90) 
j=0 


2.12 Solutions of the State Equations 


@(k) is called the state transition matrix or the fundamental matrix. An example will now be 
given to illustrate the recursive nature of the solution. 


EXAMPLE 2.29 


Consider the transfer function 


@ +°3) 


CO Gee KD 


Using the technique of Section 2.9, we write 


ffo 1 0 
x(k + 1) = E kw + Nhw 
y(k) = [3 1)x(&) 


Assume that the system is initially at rest so that x(0) = 0, y(0) = Cx(0) = 0, and the input is 
a unit step; that is, 


uk) =1, k&=0,1,2,... 


The recursive solution is obtained as follows: 


0 1 0 0 
x(1) = É xo + Juco = H 


0 
y1) = [3 ui? atl 


0 1 0 o  ıļfo 0 
Sa a | OS NAO 
1 


Then 


1 
y2) = [B uf | =3-2=1 
In a similar manner it can be shown that 
=2 
x(3) = 5b y3) = -1 


and 
=e) 5 
XD) = | o} WH = 5 ete. 


Hence one can recursively determine the states and the output at successive time instants. 
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A MATLAB program for this example is given by 


>> A = [0 1; -2 -3]; 
B = [0; 1] 
C=. iL ats 

x = [0; 0] 

Wy bs 

for (kos :0::5 

xl = A*x + Btu 

k 

y = C*x 

x = x1; Stime delay 
end 

k=012345 
y=011-15 -9 


z-Transform Method 
The general solution to the state equations 
x(k + 1) = Ax(k) + Bu(k) (2-91) 


was developed above, and is given by (2-89) 
k=l 
x(k) = ®(k)x(0) + ®(k — 1 — j)Bu(j) 
j=0 
where ®(k), the state transition matrix, is given by 


(k) = & (2-92) 


One technique for evaluating ®(k) as a function of k is through the use of the z-transform. This 
technique will now be presented. 
In (2-91), let u(k) = 0. Then the z-transform of this equation yields 


zX(z) — cx(0) = AX) (2-93) 
Solving for X(z), we see that 
X(z) = zz — AT"'x(0) (2-94) 
Then 
x(k) = 5 XO] = eI — ATO) (2-95) 


Comparing (2-95) with (2-89), we see that 
k) = z '[elel -AT] (2-96) 


To illustrate this method, consider the following example. 


2.12 Solutions of the State Equations 


EXAMPLE 2.30 


For the state equations of Example 2.29, 


0 1 
bee 
—2 <3 
Then 
Zz -1 
I- A] = 
kz l f Zk i 
and 
|I- A| =z +37+2=(@+DZ+2) 
Evaluating the inverse matrix in (2-96) and multiplying by z, we obtain 
z(z + 3) z 
2 z+ 1IXz+2 z+ I(z+2 
Jä -= Ar = ( X ) X ) 
=i zZ 
(z+ Diet 2) +I + 2) 
2 = = 
= i = : 1 i T 
z z z Z 
f —2z 2z =z 2z a) 
+ + 
zL AZRA z+1 7+2 
Thus 


AT (=o (Gr — Ge) 


P(k) = 3 kI g Ay ] = —2(-1)* 4 2(—2) —(-1) a 2(-2)* 


Numerical Method via Digital Computer 


The digital computer is ideally suited for evaluating equations of the type 
x(k + 1) = Ax(k) + Bu(k) (2-97) 


These equations can be solved recursively by the computer without actually solving for the state 
transition matrix. 

Another computer method for finding the state transition matrix is to evaluate the 
expression 


Pk) = & (2-98) 


The disadvantage of this procedure is that ®(k) is not found as a general function of k. However, 
for high-order systems, the evaluation of ®(k) as a function of k is difficult using any method. 
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Properties of the State Transition Matrix 
Three properties of the state transition matrix will now be derived. Since 
x(k) = ®(k)x(0) 
then evaluating this expression for k = 0 yields the first property: 
(0) =I 
where I is the identity matrix. Next, since 
Pk) = A 


then the second property is given by 


Pik + k) = Ath = NAS = OkO (k) 


The third property is seen from the relationships 


@(-k) = A* = [AT! = © l(k) 


or, taking the inverse of this expression, we obtain an equivalent expression 


Pk) = P-k) 


EXAMPLE 2.31 


(2-99) 


(2-100) 


(2-101) 


(2-102) 


(2-103) 


We will illustrate the properties of the state transition matrix using the system described by 


x(k) 


1 
x(k + 1) = k A 


Now 
Then, in (2-100), 


In (2-101), 


1 0 1 0 1 0 
D(k, + ky) = k Vani = k A A = Pki) (k) 


Also, in (2-103), 


1 0 =l 1 0 
ocw =|) an -| |= ew 


2.13 Linear Time-Varying Systems 


2.13 LINEAR TIME-VARYING SYSTEMS 


The state equations for a linear time-varying discrete system were given in (2-47) and (2-48), 
and are repeated here. 


x(k + 1) = A(k)x(k) + B(kju(k) (2-104) 
y(k) = C(A)x(k) + Dulk) (2-105) 


We can find the solution to these equations in a recursive manner. If we denote initial time by kp 
and assume that x(kp) is known and that u(k) is known for k = ko, then 


x(1 + ko) = A(ko)x(ko) + B(ko)u(ko) 
Thus 
x(2 + ko) = ACL + ko)x(1 + ky) + BU + ko)u(1 + ko) 
= ACL + ko)[A(Ko)x(ko) + B(ko)u(ko)] + BU + koul + ko) 
= ACL + ko)A(ko)x(ko) + ACL + ko)B(ko)u(ko) + BU + kọou(1 + ko) 
In a like manner, we see that 
x(3 + ko) = AQ + ko)x(2 + ko) + B(2 + ko)u(2 + ko) 
= A(2 + ky)AC + ko)A(Ko)x(ko) + A(2 + ky)AC + ko)B(ko)u(ko) 
+ AQ + koB(1 + koud + ko) + BO + ko)u(2 + ko) 


Now, if we define 


k-1 
@(k, ko) = A(k — DAK — 2) +++ Alko) = HAO, et (2-106) 


L k= ko 


where I is the identity matrix, then the equation above for x(3 + ko) can be written as 
2+ko 
x(3 + ko) = B3 + ko, kox(ko) + X BG + koj + DB( Du) 
J=ko 
Thus it can be shown in general that 
k-1 
x(k) = (k, ky)x(ko) + X Pk, j + DBU) (2-107) 
J=ko 
and then 
k-1 
yk) = CHE, koxko) + X CHPK j+ DBU) + Duk) (2-108) 


J=ko 


As before, ®(k, kọ) is called the state transition matrix. Note that since the matrices are time 
varying, they must be reevaluated at each time instant. 

Using (2-106) and (2-107), we can derive the following important properties of the state 
transition matrix ®(k, kọ): 


P(Ko, ko) = I 
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D (ky, ky) D(ky, ko) = Plky, ko) 


PK), ky) = B'(ky, ky) (2-109) 
Note that if the system is time invariant, then A is not a function of k. The equation for the state 
transition matrix, (2-106), then reduces to that for the time-invariant system, (2-92). It is seen 
that the time-invariant system is a special case of the time-varying system. 


2.14 SUMMARY 


In this chapter we have introduced the concepts of discrete-time systems and the modeling of 
these systems by difference equations. The z-transform was defined and was shown to be appli- 
cable to the solution of linear time-invariant difference equations. Next, four methods for deter- 
mining inverse z-transforms were presented. Finally, the representation of discrete-time systems 
by simulation diagrams and flow graphs was introduced, which leads naturally to state-variable 
modeling. Techniques for the solution of linear state equations were then presented. The founda- 
tions for the modeling and the analysis of discrete-time systems were presented in this chapter, 


and will serve for much of the mathematical basis for the following chapters. 


References and Further Readings 


[1] 


[2] 


[3] 


[4] 


[5] 


[6] 


[7] 


C. F. Gerald, Applied Numerical Analysis, 7th ed. 
Reading, MA: Addison-Wesley Publishing 
Company, Inc., 2007. 

“Software Implementation ALS Computer 
Program,” Contract N00421-75-C-0058, Bell 
Aerospace Corporation, Buffalo, NY, Mar. 1975. 
A. W. Drake, Fundamentals of Applied 
Probability Theory. New York: McGraw-Hill 
Book Company, 1967. 

A. N. Oppenheim, A. S. Willsky, and N.H. 
Nawab, Signals and System, 2nd ed. Upper 
Saddle River, NJ: Prentice-Hall, 1996. 

G. Doetsch, Guide to the Applications of the 
Laplace and z-Transforms, 2nd ed. New York: 
Van Nostrand-Reinhold, 1971. 

M. M. Guterman and Z. H. Nitecki, Differential 
Equations: A First Course, 3rd ed. Delhi: Indo 
American Book Co., 2006. 

C. R. Wylie and L.C. Barrett, Advanced 
Engineering Mathematics, 6th ed. New York: 
McGraw-Hill Book Company, 1995. 


Problems 


[8] 


[9] 


[10] 


[11] 


[12] 


[13] 


[14] 


P. M. De Russo, R. J. Roy, C. M. Close, 
and A. A. Desrochers, State Variables for 
Engineers, 2nd ed. New York: John Wiley & 
Sons, Inc., 1998. 

B. Friedland, Control System Design. Mineola, 
NY: Dover Publications, 2005. 

J. A. Cadzow and H. R. Martens, Discrete-Time 
and Computer Control Systems. Upper Saddle 
River, NJ: Prentice-Hall, 1970. 

G. F. Franklin, J. D. Powell, and M. Workman, 
Digital Control of Dynamic Systems, 3rd ed. 
Half Moon Bay, CA: Ellis-Kagle Press, 2006. 
E. I. Jury, Theory and Application of the 
z-Transform Method. Huntington, NY: R.E. 
Krieger Publishing Co., Inc., 1973. 

B. C. Kuo, Digital Control Systems, 2nd ed. 
New York: Oxford University Press, 1995. 

M. S. Fadali and A. Visioli, Digital Control 
Engineering. Waltham, MA: Academic Press, 
2009. 


2.2-1. 


The rectangular rules for numerical integration are illustrated in Fig. P2.2-1. The left-side rule is depicted 
in Fig. P2.2-1(a), and the right-side rule is depicted in Fig. P2.2-1(b). The integral of x(t) is approxi- 
mated by the sum of the rectangular areas shown for each rule. Let y(kT) be the numerical integral of 
x),0 S t S KT. 


Problems 91 


(a) Write the difference equation relating y(k + 1), y(k), and x(k) for the left-side rule. 

(b) Find the transfer function Y(z)/X(z) for part (a). 

(c) Write the difference equation relating y(k + 1), y(k), and x(k + 1) for the right-side rule. 
(d) Find the transfer function Y(z)/X(z) for part (c). 

(e) Express y(k) as a summation on x(k) for the left-side rule. 

(f) Express y(k) as a summation on x(k) for the right-side rule. 


x(t) A 
x(k) 
x(k + 1) 
Ny 
kT (k+1)T t 
(a) 
x(t) A 
x(k + 1) 
Ne > 
kT (k+1)T t 
(b) 


FIGURE P2.2-1 Rectangular rules for integration: (a) left side; (b) right side. 


2.2-2. The trapezoidal rule (modified Euler method) for numerical integration approximates the integral of a func- 
tion x(t) by summing trapezoid areas as shown in Fig. P2.2-2. Let y(t) be the integral of x(t). 
(a) Write the difference equation relating y[(k+ 1)T], y(AT), x[(k + 1)T], and x(kT) for this rule. 
(b) Show that the transfer function for this integrator is given by 


¥(z) _ (T/D + 1) 


XZ)  z=-l1 
x(t) 4 
x(k) 
x(k + 1) 
N > 
kT (k+1)T t 


FIGURE P2.2-2 Trapezoidal rule for numerical integration. 


2.2-3. (a) The transfer function for the right-side rectangular-rule integrator was found in Problem 2.2-1 to be 
Y(z)/X(z) = Tz/(z — 1). We would suspect that the reciprocal of this transfer function should yield an 
approximation to a differentiator. That is, if w(kT) is a numerical derivative of x(t) at t = kT, 

We) z-1ı 
X(z) Tz 
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2.3-2. 


2.3-3. 


2.4-1. 


2.4-2. 


2.5-1. 


2.5-2. 


2.5-3. 
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Write the difference equation describing this differentiator. 

(b) Draw a figure similar to those in Fig. P2.2-1 illustrating the approximate differentiation. 

(c) Repeat part (a) for the left-side rule, where W(z)/X(z) = T/(z — 1). 

(d) Repeat part (b) for the differentiator of part (c). 

Find the z-transform of the number sequence generated by sampling the time function e(t) = 2t every 

T seconds, beginning at t = 0. Can you express this transform in closed form? 

(a) Write, as a series, the z-transform of the number sequence generated by sampling the time function 
e(t) = © ~ every T seconds, beginning at t = 0. Can you express this transform in closed form? 

(b) Evaluate the coefficients in the series of part (a) for the case that T = 0.1 s. 

(c) The exponential e(t) = e” is sampled every T = 0.2 s, yielding the z-transform 


1 1\? 1\3 
EZ =14 14 2h Spi... 
2 @: (3) (5): 
Evaluate b. 


Find the z-transforms of the number sequences generated by sampling the following time functions every T 
seconds, beginning at t = 0. Express these transforms in closed form. 
(a) e) =E" 
b) e) = £ Pult — T) 
(c) et = £ 5Dult — 5T) 
A function e(t) is sampled, and the resultant sequence has the z-transform 
2-4 
z* — 0.92 + 0.8 


Solve this problem using E(z) and the properties of the z-transform. 

(a) Find the z-transform of e(t — 2T)u(t — 2T). 

(b) Find the z-transform of e(t + 2T)u(t). 

(c) Find the z-transform of e(t — 3T)u(t — 47). 

A function e(t) is sampled, and the resultant sequence has the z-transform 
z—b 

Ca ce +d 


Ez) = 


E(z) = 


Find the z-transform of ee 


From Table 2-3, 


(kT ). Solve this problem using E(z) and the properties of the z-transform. 


2z— cos aT) 
z — 2zcosaT + 1 


g[cos akT] = 


(a) Find the conditions on the parameter a such that [cos akT] is first order (pole-zero cancellation occurs). 
(b) Give the first-order transfer function in part (a). 

(c) Find a such that z[cos akT] = [u(kT)], where u(kT) is the unit step function. 

Find the z-transform, in closed form, of the number sequence generated by sampling the time function e(t) 
every T seconds beginning at t = 0. The function e(t) is specified by its Laplace transform, 


a1 — 2 *) 
E(s) = ; T= Is 
s(s + 4) 
Use the residue method to find the z-transform of the following functions. Check your results by computer. 
20 
E(s) = —.—— b) E(s) = ———~ 
@ EO) = er a OR) = ED 
© g9 = H @ zo =H 
c s) = —— s) => 
s(s + 1) ss + 1) 
vr +5s+6 2 
e) E(s) = ———_———_ E(s) = >=———_ 
ey) s(s + 4)(s + 5) ee) se +2s+5 


2.6-1. 


2.6-2. 


2.6-3. 


2.6-4. 


2.6-5. 


2.6-6. 


Problems 


Solve the given difference equation for x(k) using: 

(a) The sequential technique. 

(b) The z-transform. 

(c) Will the final-value theorem give the correct value of x(k) as k —> œ? 


x(k) — 5x(k — 1) + 6x(k — 2) = e(k) 


1, k=0,1 
e(k) = 
0, k=2 


x(-1) = x(-2) = 0 


where 


Given the difference equation 


3 1 
WET 2 Gee Ds gh) e(k) 


where y(0) = y(1) = 0, e(0) = 0, and e(k) = 1,k = 1,2,.... 

(a) Solve for y(k) as a function of k, and give the numerical values of y(k),0 = k = 4. 

(b) Solve the difference equation directly for y(k), 0 = k = 4, to verify the results of part (a). 
(c) Repeat parts (a) and (b) for e(k) = 0 for all k, and y(0) = 1, y(1) = —2. 

Given the difference equation 


x(k) — x(k — 1) + x(k — 2) = e(k) 


where e(k) = 1 fork = 0. 

(a) Solve for x(k) as a function of k, using the z-transform. Give the values of x(0), x(1), and x(2). 
(b) Verify the values x(0), x(1), and x(2), using the power-series method. 

(c) Verify the values x(0), x(1), and x(2) by solving the difference equation directly. 

(d) Will the final-value property give the correct value for x(%)? 

Given the difference equation 


x(k + 2) + 5x(k + 1) + 4x(k) = ek) 


w= dy k=0 


0, otherwise 


where 


x(0) = 0 
x71) = -1 
(a) Solve for x(k) as a function of k. 
(b) Evaluate x(0), x(1), x(2), and x(3) in part (a). 
(c) Verify the results in part (b) using the power-series method. 


(d) Verify the results in part (b) by solving the difference equation directly. 
Given the difference equation 


x(k + 3) — 2.2x(k + 2) + 1.57x(k + 1) — 0.36x(k) = e(k) 


where e(k) = 1 for all k = 0, and x(0) = x(1) = x(2) = 0. 


(a) Write a digital computer program that will calculate x(k). Run this program solving for x(3), x(4),.. . 


x(25). 
(b) Using the sequential technique, check the values of x(k), 0 =k = 5. 
(c) Use the z-transform and the power-series method to verify the values x(k),0 = k = 5. 
Given the MATLAB program 
S251. = 0; 
e = 0; 
for k = 0:5 
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s2 =e - sl; 
m = 0.5*s2 - sl; 


sl = s2; 
[k,m] 
e=ed+ 1; 


end 


that solves the difference equation of a digital controller. 

(a) Find the transfer function of the controller. 

(b) Find the z-transform of the controller input. 

(c) Use the results of parts (a) and (b) to find the inverse z-transform of the controller output. 
(d) Run the program to check the results of part (c). 


2.7-1. (a) Find e(0), e(1), and e(10) for 
0.8 
Be. z(z — 0.6) 


using the inversion formula. 

(b) Check the value of e(0) using the initial-value property. 

(c) Check the values calculated in part (a) using partial fractions. 
(d) Find e(k) for k = 0, 1, 2, 3, and 4 if š[e(k)] is given by 


1.98z 
(22 — 0.9z + 0.9)(z — 0.8)(22 — 1.2z + 0.27) 


EQ) = 


(e) Find a function e(t) which, when sampled at a rate of 10 Hz (T = 0.15), results in the transform 
E(z) = 2z/(z — 0.6). 
(£) Repeat part (e) for E(z) = 2z/(z + 0.6). 
(g) From parts (e) and (f), what is the effect on the inverse z-transform of changing the sign on a real pole? 
2.7-2. For the number sequence {e(k)}, 


Eg) = 


& 
(2-1) 


(a) Apply the final-value theorem to E(z). 
(b) Check your result in part (a) by finding the inverse z-transform of F(z). 
(c) Repeat parts (a) and (b) with E(z) = z/(z + 1%. 
(d) Repeat parts (a) and (b) with E(z) = z/(z + 0.9). 
(e) Repeat parts (a) and (b) with E(z) = z/(z + 0.1}. 
2.7-3. Find the inverse z-transform of each E(z) below by the four methods given in the text. Compare the values 
of e(z), for k = 0, 1, 2, and 3, obtained by the four methods. 


7 0.5 
= 0.5(z + 1) 2 2(Z T 1) 
O20) E d EOD = ZDE- 08) 


(e) Use MATLAB to verify the partial-fraction expansions. 
2.7-4. Find the inverse z-transform of each E(z) below by any method. 
0.52” 0.5 
- (b) E() = > 
(z — Dz — 0.6) (z — 1)X(z — 0.6) 


(a) Eg) = 


0.5z(z — 0.7) (d) EG) = 0.52(z — 0.7) 
E= De — 0.6" 7 @— De — 0.59) — 0.61) 


©) Eg) = 
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2.8-1. Given in Fig. P2.8-1 are two digital-filter structures, or realizations, for second-order filters. 

(a) Write the difference equation for the 3D structure of Fig. P2.8-1(a), expressing y(k) as a function of 
y(k — i) and e(k — i). 

(b) Derive the filter transfer function Y(z)/E(z) for the 3D structure by taking the z-transform of the equa- 
tion in part (a). 

(c) Write the difference equation for the 1D structure of Fig. P2.8-1(b). Two equations are required, with 
one for f(k) and one for y(k). 

(d) Derive the filter transfer function Y(z)/E(z) for the 1D structure by taking the z-transform of the equa- 
tions in part (c) and eliminating F(z). 


By By 


y(k) 


(a) 


bz 


ay =e 


a |x 


(b) 
FIGURE P2.8-1  Digital-filter structures: (a) 3D; (b) 1D. 
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(e) From parts (b) and (d), relate the coefficients a;, B; to a; b; such that the two filters realize the same 
transfer function. 
(£) Write a computer-program segment that realizes the 3D structure. This program should be of the form 
used in Example 2.10. 
(g) Write a computer-program segment that realizes the 1D structure. This program should be of the form 
used in Example 2.10. 
Shown in Fig. P2.8-2 is the second-order digital-filter structure 1X. This structure realizes the filter transfer 
function 
pocit e aA 
z=P z=PpP 
where p and p* (conjugate of p) are complex. The relationships between the filter coefficients and the coef- 
ficients in Fig. P2.8-2 are given by 


* 


gı = Re(p) g = —2 Im(A) 
& =Im(p) gy = 2 Re(A) 


(a) To realize this filter, difference equations are required for f,(k), fo(k), and y(k). Write these equations. 

(b) Find the filter transfer function Y(z)/E(z) by taking the z-transform of the equations of part (a) and 
eliminating F,(z) and F>(z). 

(c) Verify the results in part (b) using Mason’s gain formula. 

(d) Write a computer-program segment that realizes the 1X structure. This program should be of the form 
of that is used in Example 2.10. 


e(k) 


O y(k) 


FIGURE P2.8-2 Digital-filter structure 1X. 


2.8-3. 


Given the second-order digital-filter transfer function 


2z? — 2.4z + 0.72 
z? — 1.4z + 0.98 


DQR) = 


(a) Find the coefficients of the 3D structure of Fig. P2.8-1 such that D(z) is realized. 
(b) Find the coefficients of the ID structure of Fig. P2.8-1 such that D(z) is realized. 


2.9-1. 


2.9-2. 


2.9-3. 


2.10-1. 


2.10-2. 


2.10-3. 
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(c) Find the coefficients of the IX structure of Fig. P2.8-2 such that D(z) is realized. 
The coefficients are identified in Problem 2.8-2. 
(d) Use MATLAB to verify the partial-fraction expansions in part (c). 
(e) Verify the results in part (c) using Mason’s gain formula. 
Find two different state-variable formulations that model the system whose difference equation is given by: 
(a) y(k + 2) + 6y(k + 1) + 5y(k) = 2e(k) 
(b) y(k + 2) + 6y(k + 1) + 5y(k) = e(k + 1) + 2e(k) 
(c) y(k + 2) + 6y(k + 1) + 5y(k) = 3e(k + 2) + e(k + 1) + 2e(k) 
Write the state equations for the observer canonical form of a system, shown in Fig. 2-10, which has the 
transfer function given in (2-51) and (2-61) 


bız”! te ese oof biz + bo 
Zt Gy"! +++ +ayzt a 


GZ) = 


Note the relationship between the control canonical form in Fig. 2-9 and the observer canonical form 
in Fig. 2-10. The diagram of Fig. 2-9(b) can be converted to that of Fig. 9-10 by changing all signal- 
summing points to signal-distribution points, all signal-distribution points to signal-summing points, 
and reversing the signal flow direction in each signal path. The coefficient gains remain the same and 
signals are reversed in the time delay elements. These “transverse” diagrams then have the same trans- 
fer function. 

(a) Write the state equations for the simulation diagram shown in Fig. 2-6. 

(b) Find the “transverse” simulation diagram for this structure. 

(c) Write the state equations for this transverse structure. 

(d) Show that the transfer function for this transverse structure is given by (2-43). 

Find a state-variable formulation for the system described by the coupled second-order difference equa- 
tions given. The system output is y(k), and e;(k) and e,(k) are the system inputs. Hint: Draw a simulation 
diagram first. 


x(k + 2) + v(k + 1) = 4e,(k) + ek) 


v(k + 2) — v(k) + x(k) = 2ei(k) 
y(k) = v(k + 2) — x(k + 1) + e,(k) 


Consider the system described by 
«+y=[ J TEIH (k) 
x o 3% HG 


yk) = [7-2 _1]x(% 


(a) Find the transfer function Y(z)/U(z). 

(b) Using any similarity transformation, find a different state model for this system. 

(c) Find the transfer function of the system from the transformed state equations. 

(d) Verify that A given and A,, derived in part (b) satisfy the first three properties of similarity transforma- 
tions. The fourth property was verified in part (c). 

Consider the system of Problem 2.10-2. A similarity transformation on these equations yields 


d 0 
0 fe + Buck) 


yk) = Cyx(k) 


wee =| 


(a) Find dı and d3. 

(b) Find a similarity transformation that results in the A, matrix given. Note that this matrix is diagonal. 
(c) Find B, and C,,, 

(d) Find the transfer functions of both sets of state equations to verify the results of this problem. 
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2.10-4. 


2.11-1. 


2.11-2. 


2.11-3. 


2.11-4. 


2.11-5. 
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Repeat Problem 2.10-2 for the system described by 


1 2 
x(k + 1) = i o kw + hw 


yk) = [1 2)x(k) 
Consider a system with the transfer function 
Ye) _ 2 
UZ) e= 


GR) = 


(a) Find three different state-variable models of this system. 
(b) Verify the transfer function of each state model in part (a), using (2-84). 
Consider a system described by the coupled difference equation 


yk + 2) — v(k) = 0 
v(k + 1) + yk + 1) = u(k) 


where u(k) is the system input. 

(a) Find a state-variable formulation for this system. Consider the outputs to be y(k + 1) and v(k). Hint: 
Draw a simulation diagram first. 

(b) Repeat part (a) with y(k) and v(&) as the outputs. 

(c) Repeat part (a) with the single output v(x). 

(d) Use (2-84) to calculate the system transfer function with v(k) as the system output, as in part (c); that 
is, find V(z)/U(z). 

(e) Verify the transfer function V(z)/U(z) in part (d) by taking the z-transform of the given system differ- 
ence equations and eliminating Y(z). 

(f) Verify the transfer function V(z)/U(z) in part (d) by using Mason’s gain formula on the simulation dia- 
gram of part (a). 

Given the system described by the state equations 


1 0 0 1 
xk+1)=ļ1 1 ol® +] 0 luk 
01 0 0 


yk) = [0 0 1x% 


(a) Calculate the transfer function Y(z)/U(z), using (2-84). 

(b) Draw a simulation diagram for this system, from the state equations given. 

(c) Use Mason’s gain formula and the simulation diagram to verify the transfer function found in part (a). 
Section 2.9 gives some standard forms for state equations (simulation diagrams for the control canonical 
and observer canonical forms). The MATLAB statement 


[A,B,C,D] = tf2ss(num,den) 


generates a standard set of state equations for the transfer function whose numerator coefficients are given 
in the vector num and denominator coefficients in the vector den. 
(a) Use the MATLAB statement given to generate a set of state equations for the transfer function 


3z + 4 


G2) = = 
© zZ +5z+6 


(b) Draw a simulation diagram for the state equations in part (a). 
(c) Determine if the simulation diagram in part (b) is one of the standard forms in Section 2.9. 
Show that for the similarity transformation of (2-71), 


C [ad — A]!B +D = C,kI — A'B, + D, 
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2.12-1. Consider the system described in Problem 2.10-2. 
(a) Find the transfer function of this system. 
(b) Let u(k) = 1,k = 0 (a unit step function) and x(0) = 0. Use the transfer function of part (a) to find 
the system response. 
(c) Find the state transition matrix ®(k) for this system. 
(d) Use (2-90) to verify the step response calculated in part (b). This calculation results in the response 
expressed as a summation. Then check the values y(0), y(1), and y(2). 
(e) Verify the results of part (d) by the iterative solution of the state equations. 
2.12-2. The system described by the equations 


1 
+=] 


2 
0 Os kW F A 


yk) = [1 2)xtk) 


is excited by the initial conditions x(0) = [—1  2]’ with u(k) = 0 for all k. 
(a) Use (2-89) to solve for x(k), k = 0. 
(b) Find the output y(z). 
(c) Show that ®(k) in (a) satisfies the property ®(0) = I. 
(d) Show that the solution in part (a) satisfies the given initial conditions. 
(e) Use an iterative solution of the state equations to show that the values y(k), for k = 0, 1, 2, and 3, in 
part (b) are correct. 
(f) Verify the results in part (e) using MATLAB. 
2.12-3. The system described by the equations 


ll 1 1 
x(k + 1) = Be ALD + AC 


yk) = [1 —1)x(k) 


is excited by the initial conditions x(0) = [—-1 2]? with u(k) = 0 for all k. 
(a) Use (2-89) to solve for x(k), k = 0. 
(b) Find the output y(k). 
(c) Show that ®(k) in part (a) satisfies the property ®(O) = I. 
(d) Show that the solution in part (a) satisfies the given initial conditions. 
(e) Use an iterative solution of the state equations to show that the values y(k), for k = 0, 1, 2, and 3, in 
part (b) are correct. 
2.12-4. Let (A) be the state transition matrix for the equations 


x(k + 1) = Ax(k) 


Show that ®(k) satisfies the difference equation 
(k + 1) = A®D(A) 


Sampling and Reconstruction 


3.1 INTRODUCTION 


In Chapter 2 the concept of a discrete-time system was developed. We found that a discrete-time 
system is described (modeled) by a difference equation and that signals within the system are 
described by number sequences (e.g., {e(k)}). Some of these number sequences may be gener- 
ated by sampling a continuous-time signal (e.g., in digital control systems). To provide a basis 
for thoroughly understanding the operation of digital control systems, it is necessary to determine 
the effects of sampling a continuous-time signal. These topics are investigated in this chapter. 


3.2 SAMPLED-DATA CONTROL SYSTEMS 


In this section, the type of sampling that generally occurs in sampled-data control systems and in 
digital control systems is introduced, and a mathematical model of this sampling is developed. 
From this model we may determine the effects of the sampling on the information content of the 
signal that is sampled. 

To introduce sampled-data systems, we consider the radar tracking system of Fig. 3-1(a). 
This system is described in Section 1.5. We consider only the control of the yaw angle 0g(t), 
shown in the top view of the pedestal. The closed-loop system is to track the aircraft shown auto- 
matically. In Fig. 3-1(a), @p(4) is the yaw-axis pointing angle of the antenna and @,(f) is the angle 
to the aircraft. Hence the tracking error is e(t), given by 


elt) = O4(t) — Orli) 


Assume that the radar transmits every T seconds. Then the error e(f) is known only every T seconds. 
The block diagram of this system is shown in Fig. 3-1(b). The radar receiver must output a volt- 
age at every instant of time to the power amplifier. Since only e(kT) is known, a decision must 
be made as to the form of power amplifier input, e(t), for t # kT. 

In general, it is undesirable to apply a signal in sampled form, such as a train of narrow 
rectangular pulses, as shown in Fig. 3-2, to a plant, because of the high-frequency components 


3.2 Sampled-Data Control Systems 


Antenna 
Motor 


shaft 


Top view of pedestal 


(a) 


040) + e(t) | pria elt) Amplifier/motor/ Or) 
> data hold antenna system 
(b) 


FIGURE 3-1 Sampled-data control system. 


inherently present in that signal. Therefore, a data-reconstruction device, called a data hold, 
is inserted into the system directly following the sampler. The purpose of the data hold is to 
reconstruct the sampled signal into a form that closely resembles the signal before sampling. The 
simplest data-reconstruction device, and by far the most common one, is the zero-order hold. 
The operation of a sampler/zero-order hold combination is described by the signals shown in 
Fig. 3-3. The zero-order hold clamps the output signal to a value equal to that of the input signal 
at the sampling instant. 

The sampler and zero-order hold can be represented in block-diagram form as shown in 
Fig. 3-4. The signal e(t) can be expressed as 


elt) = e(O)[u(@) — ult — T)] + e(T)[ult — T) — ult — 2T)] 


+ e(Q2T)[ult — 2T) — ult — 3D] + +- (3-1) 
3 e(T) 
Z| e0) 
= e(2T) 
< 
0 T 2T Time 


FIGURE 3-2 Sampled signal in pulse form. 
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Amplitude 4 . 
e(t), input to sampler 


e(t), output of zero-order hold 


0 T 2T 3T 4T ST 
FIGURE 3-3 Input and output signals of sampler/data hold. 


~ 


where u(t) is the unit-step function. The Laplace transform of e(t) is E(s), given by 


—Ts -Ts —2Ts 
Eis) = OE = — | + arj? =e | 


S S 


—2Ts —3Ts 
€ E 
+ en Se Jee 


= as —Ts —2Ts 
= P [e(0) + e(T)e + e(2T)e 7 +] 


= < —nTs 1- g" 
= [Zeon | = | (3-2) 


n=0 


(The Laplace transform is reviewed in Appendix V, and Appendix VI gives a table of Laplace 
transforms.) 

The first factor in the last expression in (3-2) is seen to be a function of the input signal e(t) 
and the sampling period T. The second factor is seen to be independent of e(t) and therefore can 
be considered to be a transfer function. Thus the sampler/hold operation can be represented as 
shown in Fig. 3-4. The function E*(s), called the starred transform, is defined as 


E*(s) = Sie(nTye"™ (3-3) 
n=0 

Hence (3-2) is satisfied by the representation in Fig. 3-5. The operation denoted by the switch in 
Fig. 3-5 is defined by (3-3) and is called an ideal sampler; the operation denoted by the transfer 
function is called the data hold. It is to be emphasized that E*(s) does not appear in the physical 
system but appears as a result of factoring (3-2). The sampler (switch) in Fig. 3-5 does not model 
a physical sampler, and the block does not model a physical data hold. However, the combina- 
tion does accurately model the input-output characteristics of the sampler-data hold device, as 
demonstrated earlier. 


e(t) Sampler and zero-order elt) 
E(s) hold E(s) 


FIGURE 3-4 Sampler and data hold. 


3.3 The Ideal Sampler 


E(s) E*(s) -Ts E(s) 


T 
FIGURE 3-5 Representation of sampler and data hold. 


The operation symbolized by the sampler in Fig. 3-5 cannot be represented by a transfer 
function. From (3-3) we see that the output of the sampler is a function of e(t) only at t = kT, 
k =0,1,2,.... Hence many different input signals can result in the same output signal 
E*(s). However, the representation of a sampler as a transfer function would require each 
different E(s) to result in a different E*(s). Hence no transfer function exists for the sampler, 
and this property of the sampler complicates the analysis of systems of the type shown in 
Fig. 3-1(b). 

As an aside, many of the systems that we consider will have unity gain in the feedback 
path, as shown in Fig. 3-1(b). In practical systems, the sensor transfer function will appear in the 
feedback path. However, the bandwidth of the sensor is usually much greater than that of the 
plant, and thus the sensor can be considered to be a constant gain for system analysis and design. 
For a discussion of the problems in converting practical control systems to systems with unity 
gain in the feedback path, see [1]. 


3.3 THE IDEAL SAMPLER 


The inverse Laplace transform of E*(s) is, from (3-3), 


e*( = £L[E*(s)] = e(0)8() + e(T)8(t — T) 
+ e(2T)6(t — 2T) +- (3-4) 


where 6(f) is the unit impulse function occurring at t = 0. Then e*(f) is a train of impulse func- 
tions whose weights are equal to the values of the signal at the instants of sampling. Thus e*(¢) 
can be represented as shown in Fig. 3-6, since the impulse function has infinite amplitude at the 
instant it occurs. Note again that e*(f) is not a physical signal. 

The sampler that appears in a sampler/hold model is usually referred to as an ideal sam- 
pler, since nonphysical signals (impulse functions) appear on its output. This sampler is also 
referred to as an impulse modulator. To demonstrate this modulation concept, we define 


òt) = Sate — nT) = 6() + &(t — T) +-::: (3-5) 
e*(1) 


e(0) fen [en [en 


0 T 2T 3T 
FIGURE 3-6 Representation of e*(t). 
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ia 


e(t) e*(t) e(t) Impulse | e*(@ = e857 


<=> —> 
T modulator 


FIGURE 3-7 Representations of the ideal sampler. 


Then e*(t) can be expressed as 


e*(t) = e(f)8,(t) = eNA + eD — T) +- 
e(0)8(t) + e(T)8(t — T) +- (3-6) 


In this form it can be readily seen that (f) is the carrier in the modulation process, and e(f) is 
the modulating signal [2]. The Laplace transform requires e(t) to be zero for t < 0 [3]. For this 
reason the summation in (3-5) can be taken from n = —œ ton = © with no change in (3-6). 
Two equivalent representations of the ideal sampler are given in Fig. 3-7. 

A problem arises in the definition of the ideal sampler output in (3-4) if e(t) has a disconti- 
nuity at £ = kT. For example, if e(t) is a unit-step function, what value is used for e(0) in (3-4)? 
In order to be consistent in the consideration of discontinuous signals, the output signal of an 
ideal sampler is defined as follows: 


DEFINITION. The output signal of an ideal sampler is defined as the signal whose Laplace 
transform is 


E*(s) = Die(nT)e"™ (3-7) 
where e(t) is the input signal to the sampler. If e(t) is discontinuous at t = kT, where k is an 
integer, then e(kT) is taken to be e(kT*). The notation e(kT*) indicates the value of e(f) as t 
approaches kT from the right (i.e., at t = kT + A, where A is made arbitrarily small). 

It is important to note that the definition of the sampling operation as specified in (3-7) 
together with the zero-order-hold transfer function defined by 


1 = e7” 
Grols) = — ~ (3-8) 


yield the correct mathematical description of the sampler/hold operation defined by (3-2). It 
should also be noted that if the signal to be sampled contains an impulse function at a sampling 
instant, the Laplace transform of the sampled signal does not exist; but since continuous signals 
in practical situations never contain impulse functions, this limitation is of no practical concern. 


EXAMPLE 3.1 


Determine E*(s) for e(t) = u(t), the unit step. For the unit step, eT) = 1, n = 0, 1,2,.... 
Thus from (3-7), 


oo 


E*(s) = SeTe"™ = e0) + e(nT)e™ + enT)e?™ +- 
n=0 


3.4 Evaluation of E*(s) 
or 
ERG) = 1 +e™ ee tes 
E*(s) can be expressed in closed form using the following relationship. For |x| < 1, 


1 


L= 


=1ltxt+x4+--- 


The condition |x| < 1 guarantees convergence of the series. Hence the expression for E*(s) 
above can be written in closed form as 


1 


EMS) =m le] <1 


EXAMPLE 3.2 


Determine E*(s) for e(f) = £”. (From 3-7), 


[ee] 


E*(s) = Se(nT)e"™ 


n=0 

Ptele n +e Me Ah 4... 

= 1 pe tT 4 (e0 4... 
1 


= [ote a eater’ je ee < | 


3.4 EVALUATION OF E*(S) 


E*(s), as defined by (3-7), has limited usefulness in analysis because it is expressed as an infinite 
series. However, for many useful time functions, E*(s) can be expressed in closed form. In addi- 
tion, there is a third form of E*(s) that is useful. These two additional forms of E*(s) will now 
be investigated. 

As was seen in Section 3.3, we can express the inverse Laplace transform of E*(s) as 
[see (3-6)] 


e*(t) = e(t)57(t) (3-9) 


If we then take the Laplace transform of e*(t) using the complex convolution integral [3], we can 
derive two additional expressions for E*(s). These derivations are given in Appendix III. The 
resultant expressions are 


1 
E*(s) = | residues of EN =e (3-10) 
at poles a 


of EA) 
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> E(s + jno,) + a) (3-11) 


E*(s) = 5 


NI 


where w, is the radian sampling frequency, that is, w = 27/T. The residue of a function is 
defined in Section 2.7. The expression (3-10) is useful in generating tables for the starred trans- 
form E*(s), and the expression (3-11) will prove to be useful in analysis, as illustrated in the next 
section. Some examples that illustrate the use of (3-10) will now be given. 


EXAMPLE 3.3 


Determine E*(s) given that 


1 
Els) = ————— 
(s + 1X(s + 2) 
From (3-10), 
EO) 1 7 1 
1-e 7) ADA + 2)0 — & TO) 
Then 
1 
E~s)= > residues of EN —as| 
poles of E 3" 
E(\) 
= 1 p 1 | 
ADA- ETD he ADA -EEN he 
1 1 


m 1 — eet) 1 — gT6+2 


EXAMPLE 3.4 


We wish to determine the starred transform of e(t) = sin Bt. The corresponding E(s) is 


a B 
eare CEFO 


E*(s) can be evaluated from the expression 


L 5 [res | 
E*(s) = ro residues of A — DA JBA — ete) 


7 B 
AJDA — eT) 


B 
+ 
aae A= joer) 


A=- 
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1 1 1 
ALi —e MeBP 1 — e Me WT 


z e sinBT 
1 — 2e®cos BT + ets 


using the equations from Euler’s relation: 
gJPT + g JBT e/BT m gBT 
—.—; sn BT = S 


T= ; 
cos B 5 2j 


EXAMPLE 3.5 


Given e(t) = 1 — £”, determine E*(s), first using (3-3) and then (3-10). Now, 


1 
E(s) = ——— 
(s) s(s + 1) 
From (3-3), 
E*(s) = SYenTe"™ 
n=0 
= Sa = eyes 
n=0 
= —nTs _ —(1+s)nT 
= € E€ 
= 1- gT pa eg tT 
From (3-10), 
1 
E*(s) = > residues of MA + D1 eTe 
h=-1 
I-en | g0 


It is interesting to consider the case in which the function e(t) contains a time delay. For 
example, consider a delayed signal of the type 


e(t) = e(t — to)ult — to) 
From the shifting property of the Laplace transform (see Appendix V), 


E(s) = € ™ Fle ()] = € E,(s) (3-12) 
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For this case, (3-10) does not apply; instead, special techniques are required to find the starred 
transform of a delayed signal in closed form. These techniques will be presented in Chapter 4, 
where the modified z-transform is developed. However, for the special case in which the time 
signal is delayed a whole number of sampling periods, (3-10) can be applied in a slightly differ- 
ent form, 


fe E\(s)]° = g hls 5 residues of E (À) (3-13) 
ODO 


1 — gT 


where k is a positive integer (see Problem 3.4-4). 


EXAMPLE 3.6 


The starred transform of e(t) = [1 — e“ P]u(t — 1), with T = 0.5 s, will now be found. First 
we find E(s): 


g” ES ge" 


Els) = fol so) 


Therefore, in (3-13), k is equal to 2 and 


1 


E\(s) = ——— 
(9) = G4) 
Then, from (3-13), 


1 
aA + DI —- a | 


e= T 
| =g" 5 r of 


A=0,-1 


1 
=, * ia ME ge) pe 


J 


KERS. 2] 3 a a EDajg lS 
E _ g0-5s Ri = 0-541) a TR PS] _ ge 05+ D) 


a a + TE ero to) 


3.5 RESULTS FROM THE FOURIER TRANSFORM 


In this section we present some results regarding the Fourier transform. These results are helpful 
in understanding the effects of sampling a signal. 
The Fourier transform is defined by [4] 


Fle(t)] = Eljo) = / e(the dt (3-14) 
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In many texts the notation E(w) is used instead of E( jw); we discuss this further below. 
Recall the unilateral Laplace transform from Appendix V: 


L£[e(p)] = Es) = T e(nje “dt (3-15) 
0 


If e(t) is zero for t < 0, its Fourier transform is given by 


0 


Fled] = Ew) = i 


— co 


e(ne dt + i eedt 
0 


= J e(ne dt = LleA] 
0 


s=jw 


provided that both transforms exists. This result can be expressed in general as 
Fle(Qu)] = Lleu()]| s=je (3-16) 


Hence, for the case that e(t) is zero for negative time, the Fourier transform of e(t) is equal to 
the Laplace transform of e(t) with s replaced with jw. We see then the reason for expressing 
the Fourier transform as E( jo). In (3-16) it is assumed that both the Fourier transform and the 
Laplace transform exist. Recall that neither transform may exist for a given time function, or that 
the Laplace transform may exist while the Fourier transform does not. 

A plot of the Fourier transform E(jo) is called the frequency spectrum of e(t). A common 
procedure for showing the frequency spectrum is to express E(jw) as 


Eljo) = | E(jw)|e®% = | E(jw)| 20w) 


and plot | E( jo)| versus w (the amplitude spectrum) and (jœ) versus œw (the phase spectrum). 
We interpret the amplitude spectrum as giving the relative contents of a signal in different fre- 
quency bands. The meaning of the frequency spectrum of a signal is fundamental to under- 
standing the transmission of signals through systems; those readers who do not have a good 
background in this area should review this material in a signals and systems book such as [4]. 

Consider now an analog system with the input signal e(t), the output signal y(t), and the 
transfer function G(s); that is, 


Y(s) = G(s)E(s) (3-17) 


If e(t) is the unit impulse function 6(f), E(s) = 1 and Y(s) = G(s). Hence g(t) = L"G(s)] is 
the unit impulse response of the system with the transfer function G(s). A physical system cannot 
respond to an input signal before this signal is applied. For this case, g(t) = O for t < 0. A sys- 
tem that satisfies this condition is called a causal system. Consequently, for a causal system, the 
Fourier transform of the unit impulse response is equal to the Laplace transform of that response 
with s replaced with jw, provided that the Fourier transform exists. Hence, for the system of 
(3-17), the Fourier transform yields 


YGa) = G(jwo)Eo) 
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We see that G( jw) determines the manner that the frequency spectrum of the input e(t) is modi- 
fied to yield the frequency spectrum of the output y(t). The function G(jw) is called the fre- 
quency response. 


3.6 PROPERTIES OF E*(s) 


Two s-plane properties of E*(s) are now given. These properties are very important and will be 
used extensively in later derivations. 


PROPERTY 1. £*(s) is periodic in s with period jw,. 
This property can be proved using either (3-3), (3-10), or (3-11). From (3-3), 


o0 


E*(s + jma,) = Seah er? (3-18) 
n=0 


Since w,T = (207 /T)T = 27, and from Euler’s relationship, 
e = cos0 + jsind 
then 


gre t= gima — 1, forman integer (3-19) 


Thus, in (3-18), 


o0 


E*(s + jmw,) = SenTye"™ = E*(s) (3-20) 
n=0 


PROPERTY 2. If E(s) has a pole at s = sı, then E*(s) must have poles at s = sı + jmw,, 
m = 0,+1,42,... 

This property can be proved from (3-11). Consider e(t) to be continuous at all sampling 
instants. Then 


E*(s) = - > Es + jno,) = HIE) + E(s + jw,) + Els + 2jw,) 


n=—% 


+ + Els — jwp) + Els — 2jw) ++] (3-21) 


If E(s) has a pole at s = s4, then each term of (3-21) will contribute a pole at s = s} + jmo, 
where m is an integer. 

It is important to note that no equivalent statement can be made concerning the zeros of 
E*(s); that is, the zero locations of E(s) do not uniquely determine the zero locations of E*(s). 
However, the zero locations are periodic with period jw,, as indicated by the first property 
of E*(s). 

An example of pole—zero locations of E*(s) is given in Fig. 3-8. The primary strip in the 
s-plane is defined as the strip for which —w,/2 = w = w,/2, as shown in Fig. 3-8. Note that if 
the pole—zero locations are known for E*(s) in the primary strip, then the pole—zero locations in 
the entire s-plane are also known. 


3.6 Properties of E*(s) 
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FIGURE 3-8 Pole—zero locations for E*(s). 


In Fig. 3-8, if E(s) has a pole at —o, + jœ, the sampling operation will generate a pole in 
E*(s) at —o, + j(@ + w,). Conversely, if E(s) has a pole at —o, + j(@; + ,), then E*(s) will 
have a pole at —o, + jw. In fact, a pole location in E(s) at —o, + j(w,; + ko,), k an integer, 
will result in identical pole locations in E*(s), regardless of the integer value of k. 

The conclusion above can also be seen from the example of Fig. 3-9. Note that both signals 
have the same starred transform, since the two signals have the same value at each sampling 
instant. Note also that w; = w,/4, or, = 4. Since 


S 


E =F t] = = 
(s) eosin s + o? (s + jw )(s — jo) 


then E,(s) has a pole at s = jw,. And since 


s 
(s + j3w1)(s — J391) 


E,(s) = L[cos3w,t] = 


then £,(s) has a pole at s = —j3m,; = j(@, — w). The other pole of E,(s) occurs at s = —jo, 
and the other pole of E>(s) occurs at s = j3w, = j(—w, + w). 

The following discussion is based on the results of the Fourier transform given in the 
preceding section. Suppose that the signal e(f) has the amplitude spectrum | E(jw)| shown in 
Fig. 3-10(a), where E(jw) is the Fourier transform of e(t). Then E*( jw) has the amplitude spec- 
trum shown in Fig. 3-10(b). This can be seen by evaluating (3-21) for s = jw. 


N e =cos w(t) e(t) = cos 3w, (t) 


~ 


FIGURE 3-9 Two signals that have the same starred transform. 
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| E(jo) | 


(a) 


Fjo, Tjo, jo, jo, © 
(c) 
FIGURE 3-10 Frequency spectra for E(jw) and E*(jw). 
Par , : ; À 
E*(jo) = zE») + Eljo + jos) + Eo + 2jw,) + 
+ E(jo — jw) + Eljo — j2w) + +++ ] + e(0)/2 (3-22) 


Hence the effect of ideal sampling is to replicate the original spectrum centered at w,, at 2w,, at 
—w, at —2w,, and so on. 

An ideal filter is a filter with a unity gain in the passband and zero gain outside the pass- 
band. Of course, such a filter is not physically realizable [5]. It is seen from Fig. 3-10(b) that 
an ideal low-pass filter could completely recover E( jw), and hence e(t), if the bandwidth of the 
filter were w,/2, for the case that the highest frequency present in E(jw) is less than w,/2. This 
is, of course, essentially a statement of Shannon’s sampling theorem [6]. 


SHANNON'S SAMPLING THEOREM. A time-varying signal e(t) whose Fourier transform con- 
tains no frequency components greater than fọ Hertz is uniquely determined by the values of e(t) 
at any set of sampling points spaced 1 /(2fọ) seconds apart. 

Suppose, in Fig. 3-10(b), that w, is decreased until the highest-frequency components 
present in E(jw) are greater than w,/2. Then E*(jw) has the amplitude spectrum shown 
in Fig. 3-10(c); and for this case, no filtering scheme, ideal or realizable, will recover e(t). Thus, 
in choosing the sampling rate for a control system, the sampling frequency should be greater than 
twice the highest-frequency component of significant amplitude of the signal being sampled. 


3.7 Data Reconstruction 


It is to be recalled that the ideal sampler is not a physical device, and thus the frequency 
spectrum, as shown in Fig. 3-10, is not the spectrum of a signal that appears in a physical system. 
The ideas above will be extended to signals that do appear in physical systems after an investiga- 
tion of data holds. 


3.7 DATA RECONSTRUCTION 


In most feedback control systems employing sampled data, a continuous-time signal is recon- 
structed from the sampled signal. The block diagram of a simple sampled-data control system is 
repeated in Fig. 3-11. Suppose that the sampled signal is band limited in frequency, such that the 
highest-frequency component of e(f) is less than w,/2. Then E*(jw) would have the frequency 
spectrum shown in Fig. 3-10(b), and theoretically the signal could be reconstructed exactly by 
employing an ideal low-pass filter. However, since ideal filters do not exist in physically realiz- 
able systems, we must employ approximations. Practical data holds are devices that approxi- 
mate, in some sense, an ideal low-pass filter. 

The reader may ask: Why discuss a sampled-data system as illustrated in Fig. 3-11? The sys- 
tem contains a sampler to examine a continuous-time signal at discrete instants of time. Then a data 
hold is employed to try to reconstruct the original signal! Our reply is that many existing control sys- 
tems actually operate in this manner due to hardware implementation techniques. More important, 
we will later add a digital compensator block between the sampler and data-hold device in order to 
improve system performance, and the sampler is required in this case. In either case, our discussion 
of data-hold devices in this chapter is prerequisite to closed-loop system analysis and synthesis. 

A commonly used method of data reconstruction is polynomial extrapolation. Using a 
Taylor’s series expansion about t = nT, we can express e(t) as 


e"(nT) 


2! 


elt) = e(nT) + e'(nT\(t — nT) + (t— nT) ++: (3-23) 


where the prime denotes the derivative. e„(t) is defined as the reconstructed version of e(t) for the 
nth sample period; that is, 


e,t) = e(t) for nT st<(n+ 1)T (3-24) 


Thus e,(f) denotes the output of the data hold. Since e(t) enters the data hold only in sampled 
form, the values of the derivatives are not known. However, the derivatives may be approxi- 
mated by the backward difference 


1 
e'(nT) = ple@?) — e[(n — 1)T]] (3-25) 
1 
e"(nT) = ple OT) — e'[(n — 1)T]] (3-26) 
J e(t) Sampler e,(t) 
r(t) = and e Plant c(t) 
M data hold 


FIGURE 3-11 Sampled-data control system. 
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and so forth. Note that by substituting (3-25) into (3-26), we obtain 


i _ fil 1 
e"(nT) = T pleat) el — 1)T]] rel 1)T] — e[(n — 2)T]] 
or 
e"(nT) = pale) — 2e[(n — 1)T] + e[(n — 2)T]] (3-27) 


Three types of data hold based on the foregoing relationships (the zero-, first-, and fractional-order 
holds) will now be discussed. 


Zero-Order Hold 


If only the first term in the expansion of (3-23) is used, the data hold is called a zero-order hold. 
Here we assume that the function e(t) is approximately constant within the sampling interval 
at a value equal to that of the function at the preceding sampling instant. Therefore, for the 
zero-order hold, 


e(t)=e(nT), nT<t<(n+1T (3-28) 


Recall that the e„(t) for a zero-order hold has been defined as e(t) in (3-1). Note that no 
memory is required, and therefore this data hold is the simplest to construct. The transfer func- 
tion of the zero-order hold was derived in (3-2). However, this transfer function will be derived 
again using a simpler technique, one that may be easily used in the derivations of transfer func- 
tions for other data holds. Using the model of Fig. 3-5 for the sampler-data-hold device, we note 
that the input to the data hold will be only impulse functions. The signal e,(t) shown in Fig. 3-12 
then describes the data hold output if the input e;(t) to the data hold is a unit impulse function. 
Thus 


e(t) = u(t) — u(t — T) 


and 


e,(t) e,(t) 


Unit impulse 
function 


a 


t T 
FIGURE 3-12 Input and output signals for the zero-order hold. 


=Y 


3.7 Data Reconstruction 


Since E,(s) = 1, the transfer function of the zero-order hold is 


Exs) 1-e% 
E{s) S 


Grols) = (3-29) 


as has already been shown in (3-2). In addition, recall that (3-29) is not the transfer function of 
a physical device since this equation was derived assuming that impulse functions occur at the 
input to the zero-order hold. Thus, as shown earlier in this chapter, if (3-7) is used to describe the 
sampling operation mathematically, and if (3-29) is used in conjunction with (3-7) to describe 
the data hold mathematically, a correct mathematical model of the overall sample-hold operation 
is obtained. 

To obtain the frequency response of the zero-order hold, consider the following 
development: 


gMt -j(@T/2) F gf(T/2) _ g—j(wT/2) 
Gio(jo) = 178E% {OTD g-HOT/2) _ 2e7 [= g 
Jo 5 3 
= sin(wT/2) —j(@T/2) oT 


Since 


The expression (3-30) can be rewritten as 


sin(Tw/w,) 
r mE 


Gio(jo) = T o/o) (3-31) 
To / W, 
Thus 
: sin(a@ / ,) 
(Gojo) = T —— — (3-32) 
TA/Os 
and 


0,  sin(Tmw/w,)>0 
m, sin(mw/w)<0 


Z Gio jo) = a +0, 60= { (3-33) 


The amplitude and phase plots for G,9(jw) are shown in Fig. 3-13. 

A word is in order concerning the interpretation of the frequency response of the zero-order 
hold. First, it must be remembered that the data hold must be preceded by an ideal sampler. Now, 
suppose that a sinusoid of frequency w; is applied to the ideal sampler, where w; < w,/2. Recall 
that the Fourier transform of e(t) = 2 cos w;ź is given by 


E(jw) = F[2 cos wt] = lw — w) + lw + w) 


The frequency spectrum of this sinusoid is then two unit impulse functions, as shown in 
Fig. 3-14(a). In this Fig., the lengths of the arrows representing the impulse functions denote the 


115 


116 


Chapter 3 ¢ Sampling and Reconstruction 


|Gioio)| 4 
T 
T| 
2 
| > 
0 Ws Os 2, w 
2 
LG Qo) A mA dw u 
0 i > 


—90° 


—180° 


FIGURE 3-13 Frequency response of the zero-order hold. 


weights. Then, from (3-22), the output of the sampler contains the frequencies in the time domain 
represented by the impulse functions in the frequency domain, as shown in Fig. 3-14(b). Thus 
the frequency response of the zero-order hold may be used to determine the amplitude spectrum 
of the data-hold output signal. The output signal components are shown in Fig. 3-14(c). Hence a 
signal of the type shown in Fig. 3-15 has the frequency spectrum of Fig. 3-14(c). 

Note that the output signal amplitude spectrum will be the same as that shown in 
Fig. 3-14(c) if the input signal frequency is 


w = kw, + wo, k=0,1,2,3,.... 


Hence any frequencies w > w,/2 will reflect into the frequency range 0 < w < w,/2. This 
effect is called frequency foldover, or frequency aliasing. These reflected frequencies will be 
interpreted by the system as low-frequency information in e(t), which generally cannot be toler- 
ated. The frequency aliasing can be prevented either by increasing w, or by placing an analog 
antialiasing filter in front of the sampler. The antialiasing filter is a low-pass filter that removes 
any frequencies in e(f) that are greater than w,/2. Since low-pass filters introduce phase lag, the 
cutoff frequency of the antialiasing filter cannot be made so low as to destabilize the control sys- 
tem. As a final point, note that, in Fig. 3-14, when w; << w,/2, the high-frequency components 
of E*(jw) will occur near zeros of Gyo( jw); hence the sampler and zero-order hold will have 
little effect on the signal. 


| E(jo) | 3.7 Data Reconstruction 
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30, 0; w, —O, OF w, OA 3w, (0) 
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| E*(jo) | 
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FIGURE 3-14 Sinusoidal response of the sampler and zero-order hold; (a) input signal to the ideal 
sampler; (b) output signal of the ideal sampler; (c) output signal from the zero-order hold. 


`~ 


FIGURE 3-15 Output of a sampler/zero-order hold for a sinusoidal input. 
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Suppose that the frequency w,, in Fig. 3-14, is equal to w,/2. In this case the frequency 
components w; and w, — œ; are superimposed, and the data-hold output is a function of the 
phase of the input sinusoid. Note that the amplitude of the data-hold output can range from 0 to a 
value greater than the amplitude of the input signal. We emphasize this effect by showing arrows 
at kw, + w,/2,k = 0,1,2,..., in Fig. 3-13. 


First-Order Hold 
The first two terms of (3-23) are used to realize the first-order hold. Therefore, 

e,t) = enT) + e'(nT\(t — nT), nTSt<(n+ IT (3-34) 
where, from (3-25), 


e'(nT) = e(nT) — T — 1)T] (3-35) 


This expression indicates that the extrapolated function within a given interval is a straight line 
and that its slope is determined by the values of the function at the sampling instants in the previ- 
ous interval. Note that memory is required in the realization of this data hold, since e[(n — 1)T] 
must be available at t = nT. 

To determine the transfer function of a first-order hold, assume that the input is a unit 
impulse function. Then, from (3-34) and (3-35), the output, shown in Fig. 3-16(a), is 


e(t) = u(t) + “tu 2u(t — T) =a T)u(t — T) + u(t — 2T) 
+ y — 2T)u(t — 2T) 


eit) e,(t) 


a) 2 
Unit impulse 


function oT 
> 0 = 
T t 
—1 
(a) 
Output of 
Amplitude 4 data hold 


Input of 
sampler 
| | | | = 
0 T 2T 3T 4T t 


(b) 
FIGURE 3-16 Example of the output of a first-order hold. 


3.7 Data Reconstruction 
Since E,(s) = 1, 


E, 1 2% e°” 1 
©- + i Soe + e?) 
E) s s S Ts 


Gals) = 


or 


(3-36) 


An example of the input-output waveforms of a sampler and first-order hold is shown in 
Fig. 3-16(b). 
The frequency response of the first-order hold is obtained from (3-36). 


2 1+ joTf1- zj 
Gn (jo) T | Ja 
; A4nw? T sin (tw /w,) |” 
(Gao) = Ty} 1 + ze ok | (3-37) 
2 2 
ZGy(jo) = an ( z2) = a (3-38) 


The amplitude and phase characteristics of the first-order hold are shown in Fig. 3-17. Note that 
the first-order hold provides a better approximation of the ideal low-pass filter in the vicinity of 
zero frequency than does the zero-order hold. However, for larger w, the zero-order hold yields 
a better approximation. Consider once again the sideband frequencies generated by the sampling 
process, as illustrated in Fig. 3-14(b). If ©) << o,/2, the first-order hold provides better recon- 
struction of the sampled signal than does the zero-order hold. However, if w is of the same order 
of magnitude as w,/2, the zero-order hold may yield better results in the reconstruction process. 
Thus in some applications the zero-order hold is superior to the first-order hold. However, in any 
case, the zero-order hold is by far the most commonly used device, because of cost considerations. 


Fractional-Order Holds 


When using the first-order hold we essentially perform a linear extrapolation from one sampling 
interval to the next; that is, we assume that by using the approximate slope of the signal in the 
interval from (n — 1)T to nT we can obtain the value of the signal at (n + 1)T. The error gener- 
ated in this process can be reduced by using only a fraction of the slope in the previous interval, 
as shown in Fig. 3-18. In this Fig. it is assumed that the input is a unit impulse and the value of k 
ranges from zero to unity. The frequency response of this data hold is shown in Fig. 3-19. Note 
that for k = 0, the hold is a zero-order hold; for k = 1, a first-order hold is obtained. Although it 
is difficult to determine the optimum value of k except in certain specific circumstances, the frac- 
tional-order hold may be used to match the data-hold frequency response to the sampled signal’s 
frequency spectrum, thereby generating minimum error extrapolations. By using the techniques 
given above, the transfer function of the fractional-order hold can be shown to be 


_ gT 


Gn(s) = (A ket! + Sa eye (3-39) 
S 


The derivation of this transfer function is given as an exercise in Problem 3.7-11. 
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FIGURE 3-17 Frequency response of the first-order hold. 


FIGURE 3-18 Impulse response of the fractional-order hold. 
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FIGURE 3-19 Frequency response magnitudes for the fractional-order hold. 


3.8 SUMMARY 


The material presented in this chapter is fundamental to the study of sampled-data control sys- 
tems. The sampling and reconstruction processes are an integral part of these systems, and it is 
important to have a good understanding of these topics before proceeding to the more advanced 
topics in analysis and design. The mathematical model of the sample-hold operation, Fig. 3-5, is 
basic to all analysis and design of digital control systems. 
An important result of the topics developed in this chapter is the development of approxi- 
mate rules for the choice of the sample period T for a given signal. Although this chapter empha- 
sized the importance of the frequency contents of a signal in determining its sampling rate, later 
chapters will show the importance of a system’s frequency response in determining the sample 
rate to be used in that system. 
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Problems 


3.2-1. 


3.3-1. 


3.4-1. 


3.4-2. 


3.4-3. 


3.4-4. 


3.4-5. 


3.4-6. 


3.4-7. 


3.6-1. 


(a) Give the definition of the starred transform. 

(b) Give the definition of the z-transform. 

(c) For a function e(t), derive a relationship between its starred transform E*(s) and its z-transform E(z). 

A signal e(t) is sampled by the ideal sampler as specified by (3-3). 

(a) List the conditions under which e(t) can be completely recovered from e*(f), that is, the conditions 
under which no loss of information by the sampling process occurs. 

(b) State which of the conditions listed in part (a) can occur in a physical system. Recall that the ideal 
sampler itself is not physically realizable. 

(c) Considering the answers in part (b), state why we can successfully employ systems that use sampling. 

Use the residue method of (3-10) to find the starred transform of the following functions. 


1 10 
= ae Dees © EOT GD 
c s) = s+) s) = FD 
st 55 +6 2 
EON ae) OE FIs 
Find E*(s) for each of the following functions. Express E*(s) in closed form. 
—4Ts 
(a) e(t) = e” (b) E(s) = 
$= 2 
(c) elt) = ef “u(t — 4T) (d) e) = Pult — T/4) 


For e(t) = e. 

(a) Express E*(s) as a series. 

(b) Express E*(s) in closed form. 

(c) Express E*(s) as a series which is different from that in part (a). 

Express the starred transform of e(t — kT)u(t — kT), k an integer, in terms of E*(s), the starred transform 
of e(t). Base your derivation on (3-3). 

Find E*(s) for 


Find E*(s), with T = 0.2 s, for 


je 
(s + 1)(s + 2) 
Suppose that E*(s) = [e()]* = 1. 
(a) Find e(kT) for all k. 
(b) Can e(t) be found? Justify your answer. 
(c) Sketch two different continuous-time functions that satisfy part (a). 
(d) Write the equations for the two functions in part (c). 
(a) Find E*(s), for T = 0.1 s, for the two functions below. Explain why the two transforms are equal, first 
from a time-function approach, and then from a pole—zero approach. 
(i) e = cos(4rt) 
(ii) e(t) = cos(16rt) 
(b) Give a third time function that has the same E*(s). 


3.6-2. 


3.7-1. 


3.7-2. 


3.7-3. 


3.7-4. 


3.7-5. 


3.7-6. 


3.7-7. 
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Compare the pole—zero locations of E*(s) in the s-plane with those of E(s), for the functions given in 

Problem 3.4-1. 

A system is defined as linear if the principle of superposition applies. Is a sampler/zero-order-hold device 

linear? Prove your answer. 

Suppose that the signal e(t) = cos[(w,/2)t + 6] is applied to an ideal sampler and zero-order hold. 

(a) Show that the amplitude of the time function out of the zero-order hold is a function of the phase 
angle 0 by sketching this time function. 

(b) Show that the component of the signal out of the data hold, at the frequency w = ,/2, is a function of 
the phase angle 0 by finding the Fourier series for the signal. 

(a) A sinusoid with a frequency of 2 Hz is applied to a sampler/zero-order hold combination. The sampling 
rate is 10 Hz. List all the frequencies present in the output that are less than 50 Hz. 

(b) Repeat part (a) if the input sinusoid has a frequency of 8 Hz. 

(c) The results of parts (a) and (b) are identical. Give three other frequencies, which are greater than 50 Hz, 
that yield the same results as parts (a) and (b). 

Given the signal e(t) = 2sin5t + 4sin3t. 

(a) List all frequencies less than œ = 50 rad/s that are present in e(^. 

(b) The signal e(t) is sampled at the frequency w, = 20 rad/s. List all frequencies present in e*(f) that are 
less than w = 50 rad/s. 

(c) The signal e*(t) is applied to a zero-order hold. List all frequencies present in the hold output that are 
less than w = 50 rad/s. 

(d) Repeat part (c) for e*(1) applied to a first-order hold. 

A signal e(t) = 2sin3t is applied to a sampler/zero-order-hold device, with œ = 6 rad/s. 

(a) What is the frequency component in the output that has the largest amplitude? 

(b) Find the amplitude and phase of that component. 

(c) Sketch the input signal and the component of part (b) versus time. 

(d) Find the ratio of the amplitude in part (b) to that of the frequency component in the output at 
w = 7rad/s (the input frequency). 

It is well known that the addition of phase lag to a closed-loop system is destabilizing. A sampler/data-hold 

device adds phase lag to a system, as described in Section 3.7. A certain analog control system has a 

bandwidth of 10 Hz. By this statement we mean that the system (approximately) will respond to frequen- 

cies less than 10 Hz, and (approximately) will not respond to frequencies greater than 10 Hz. A sampler/ 
zero-order-hold device is to be added to this control system. 

(a) It has been determined that the system can tolerate the addition of a maximum of 10° phase lag within the 
system bandwidth. Determine the approximate minimum sampling rate allowed, along with the sample 
period T. 

(b) Repeat part (a) for a maximum of 5° phase lag. 

(c) Repeat part (a) for a maximum of 20° phase lag. 

A sinusoid is applied to a sampler/zero-order-hold device, with a distorted sine wave appearing at the out- 

put, as shown in Fig. 3-15. 

(a) With the sinusoid of unity amplitude and frequency 2 Hz, and with f, = 12 Hz, find the amplitude and 
phase of the component in the output at fi = 2 Hz. 

(b) Repeat part (a) for the component in the output at (fs — fi) = 10 Hz. 

(c) Repeat parts (a) and (b) for a sampler-first-order-hold device. 

(d) Comment on the distortion in the data-hold output for the cases considered in parts (a), (b), and (c). 
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3.7-8. A polygonal data hold is a device that reconstructs the sampled signal by the straight-line approximation 


shown in Fig. P3.7-8. Show that the transfer function of this data hold is 


eh] _ eS)? 


G(s) = T? 


Is this data hold physically realizable? 


Input to 
sampler 


Data-hold 
output 


> 
0 T 2T 3T 4T 5T 
FIGURE P3.7-8 Response of a polygonal data hold. 


3.7-9. A data hold is to be constructed that reconstructs the sampled signal by the straight-line approximation 


shown in Fig. P3.7-9. Note that this device is a polygonal data hold (see Problem 3.7-8) with a delay of T 
seconds. Derive the transfer function for this data hold. Is this data hold physically realizable? 


ry 
Input to a 
sampler 4 pO aay 
. Ossa 
, 
a 
Pa 
Fá Data-hold 
/ output 
k | | 2 
0 T: 2T 3T 4T 


FIGURE P3.7-9 Response of a polygonal data hold with time delay. 


3.7-10. Plot the ratio of the frequency responses (in decibels) and phase versus for the data holds of Problems 3.7-8 
and 3.7-9. Note the effect on phase of making the data hold realizable. 
3.7-11. Derive the transfer function of the fractional-order hold [see (3-39)]. 
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3.7-12. Shown in Fig. P3.7-12 is the output of a data hold that clamps the output to the input for the first half of the 
sampling period, and returns the output to a value of zero for the last half of the sampling period. 


(a) Find the transfer function of this data hold. 
(b) Plot the frequency response of this data hold. 


(c) Comparing this frequency response to that of the zero-order hold, comment on which would be better 


for data reconstruction. 


Sampler ’ 
input se 


Data-hold 
output 


Nn 


T T 3T 2T T 3T TL 


2 2 2 2 
FIGURE P3.7-12 Data hold output for Problem 3.7-12. 


Open-Loop 
Discrete-Time Systems 


4.1 INTRODUCTION 


In the preceding chapters, the topics of discrete-time systems, z-transforms, and sampling and 
data reconstruction were developed. In this chapter these developments are utilized to derive 
analysis methods for open-loop discrete-time systems. (The derivations are necessary, since the 
ideal sampler does not have a transfer function.) These analysis techniques will then be extended 
to closed-loop systems in the chapters that follow. 


4.2 THE RELATIONSHIP BETWEEN E(z) AND E*(s) 


To provide the proper background for our analysis of open-loop systems, let us establish the 
relationship that exists between E(z) and E*(s). Recall that in Chapter 2 the z-transform of the 
number sequence {e(k)} was defined in equation (2-7) to be 


gl{e()}] = E(z) = e0) + e)z! + eQ)z 7+ > (4-1) 

In addition, the starred transform for the time function e(t) was defined in equation (3-7) as 
E*(s) = e0) + ee ™ + ene? + --- (4-2) 

The similarity between these two transforms is obvious. In fact, if we assume that the number 
sequence {e(k)} is obtained from sampling a time function e(f) [i.e., if e(k) of (4-1) is equal to 


e(kT) of (4-2)], and if T= z in (4-2), then (4-2) becomes the z-transform. Hence in this case 


E(z) = E*(s) 


cae (4-3) 


We see then that the z-transform can be considered to be a special case of the Laplace transform for 
our purposes. We will employ the change of variable in (4-3), and, in general, use the z-transform 
instead of the starred transform in our analysis of discrete-time systems. In addition, if the starred 


4.3 The Pulse Transfer Function 


transform is required, we will first use the z-transform tables to find E(z), and then use the inverse 
of (4-3) to find E*(s). This approach is illustrated by the following example. 


EXAMPLE 4.1 


Let 
1 


EON eu ANS 423 


Then, from the z-transform tables in Appendix VI, 


z(e 7 ia e277) 
sT— 


Me gee e-e 


E(z) = E*(s) 


Hence 
eh(e 7 =: ef) 


(e™ = eTe” a et} 


E*(s) = 
which checks that derived in Example 3.3 via (3-10). 


Note that in Example 4.1, £*(s) has an infinite number of poles and zeros in the s-plane. 
However, E(z) has only a single zero at z = 0, and two poles—one at £7 and the other at e”. 
Thus any analysis procedure that utilizes a pole-zero approach is greatly simplified through the 
use of the z-transform. Other advantages of this approach will become obvious as we develop 
analysis techniques for sampled-data systems. 

E(z) can now be calculated from (3-10) via the substitution in (4-3) as 


E(z) = D residues of E(\) i l (4-4) 


at poles = z g 
of EA) 
This expression is useful in generating z-transform tables. Because of the relation between E(z) 
and E*(s), the theorems developed in Chapter 2 for the z-transform also apply to the starred 
transform. In addition, z-transform tables become tables of starred transforms with the substitu- 
tion z = £". For this reason, a separate table for starred transforms is usually not given. 


4.3 THE PULSE TRANSFER FUNCTION 


In this section we develop an expression for the z-transform of the output of open-loop 
sampled-data systems. This expression will be required later when we form closed-loop systems 
by feeding back this output signal. 

Consider the open-loop system of Fig. 4-1(a), where G,(s) is the plant transfer function. We 
denote the product of the plant transfer function and the zero-order hold transfer function as G(s), 
as shown in the figure; that is, 


—Ts 


i= K 
Gs) = —*— G(s) 
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E(s) E*(s) l-g” G(s) Cs) 
T —s al 


E(s) E*(s) C(s) 


G(s). p m 


y 


(b) 
FIGURE 4-1 Open-loop sampled-data system. 


Hence this system can be represented as shown in Fig. 4-1 (b). Note that when a representation 
of a system as shown in Fig. 4-1(b) is given, G(s) must contain the transfer function of a data 
hold. In general, we do not show the data-hold transfer function separately but combine it with 
the transfer function of that part of the system that follows the data hold. 

In Fig. 4-1, 


C(s) = G(S)E*) (4-5) 


Assume that c(t) is continuous at all sampling instants. From (3-11), 


c*(s) = = X, Cis + jno) = [G(s E*(s)}* (4-6) 


| 


oe 


where [:]* denotes the starred transform of the function in the brackets. Thus, from (4-5) 
and (4-6), 


CX(s) = = X, Gs + jnw,)E*(s + jnw,) (4-7) 


| i 


miles 


Equation (3-20) gives the periodic property 
E*(s + jnw,) = E*(s) 


Thus (4-7) becomes 


co 


C*(s) = Eo) S, Gs + jnw,) = E*(s)G*(s) (4-8) 


n=—-« 


and then from (4-3), 
C(z) = E(z)G(z) (4-9) 
Now G(z) is called the pulse transfer function and is the transfer function between the sampled 


input and the output at the sampling instants. Note that the pulse transfer function gives no 
information on the nature of the output, c(t), between sampling instants. This information is not 


4.3 The Pulse Transfer Function 
contained in either (4-8) or (4-9). However, we generally choose the sample frequency such that 
the response at sampling instants gives a very good indication of the response between sampling 
instants. 

The derivation above is completely general. Thus given any function that can be 
expressed as 
A(s) = B(s)F*(s) (4-10) 
where F*(s) must be expressible as 
F¥(s) = fo + fie? + fer™ + -- 
then, from the preceding development, 
A*(s) = B*(s)F*(s) (4-11) 
Hence, from (4-3), 
A(z) = B(z)F(z) (4-12) 


where B(s) is a function of s and F*(s) is a function of £75; that is, in F*(s), s appears only in the 
form £™. Then, in (4-12), 


Bz) = 3[BO)], F) = F*(s) 


Ts (4-13) 


Ee =z 


The following examples illustrate this procedure. 
EXAMPLE 4.2 


Suppose that we wish to find the z-transform of 
bager. al 
s(s + 1) s(s + 1) 


A(s) = =e) 


From (4-10), we consider 


and 
z-1 
Z 


F(s)=1-e€° => FQ=1-z7!= 


Then, from the z-transform tables, 
d -eaz 


s(s + 5l ~ @- De-€%) 


Biz) = j| 
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and 


— et = ee A 
PEE ee d—e)z É |=! e 


G=De-e DL z z-e" 


EXAMPLE 4.3 


Given the system shown in Fig. 4-2, with input e(t) a unit step function, let us determine the 
output function C(z). 
Now, 
—Ts 


C(s) se +D E*(s) = G(s)E*(s) 


In Example 4.2 it was shown that 


Se ee 
G@) E Fz = 


In addition, from the table in Appendix VI, 


Z 


W= 


Thus 


(1-8 — z z 


Ce) = GER) = C- DQ-e£) z-1 z- 


E(s) |- gt 1 C(s) 
=| [>| — 
T 5 sal 
(a) 
c(kT) A 
SSS SSeS SSeS Ra a 
wo aa i 
Lr ! ! | 
oc? l I | | 
- 1 l l 1 
Mig 1 1 1 1 
of! 1 l 1 1 
o! 1 l 1 I 
> l 1 l 1 1 
Ko | | | | 
Pa 1 1 1 1 1 
é L L L L L — 
0 T 2T 3T 4T 5T t 
(b) 


FIGURE 4-2 Sampled-data system. 
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and the inverse z-transform of this function yields 
c(kT) =1—e¢% 
This response is plotted in Fig. 4-2(b). 


Note that the output in Fig. 4-2(b) rises exponentially to a final value of unity at the sam- 
pling instants. Note also that the z-transform analysis yields the response only at the sampling 
instants. Based on the preceding analysis, we know nothing about the response of the system 
between sampling instants. If this information is needed (it normally is in a practical situation), 
we usually find the complete response by simulation. 

If the input to the sampler/zero-order hold is a unit step signal, the output is also a unit step 
signal. Thus the zero-order hold reconstructs the sampled step function exactly. Because of this, 
the response of the system of Fig. 4-2 is simply the step response of a continuous-time system 
with a transfer function of 1/(s + 1). The reader can calculate this response to be 


c(t) =1-—e7 


The z-transform analysis of the last example is then seen to be correct. Given c(t), we can find 
c(kT) by replacing t with kT. However, given c(kT) from a z-transform analysis, we cannot 
replace nT with ¢ and have the correct expression for c(t), in general. 

A final point will be made relative to the example above. For many control systems, 
the steady-state gain for a constant input is important; we will call this gain the dc gain. For 
a system of the configuration of Fig. 4-1, the steady-state output, c,,(k), for an input of unity 
[E(z) = z/(z — 1)], is, from the final-value property, 


ess(k) = lim((z = DCO) = lim(Z — IG@E@)) 


Z 


= lin( — 1)G() ) = lim G(z) = G(1) 


zel 
assuming the c,,(k) exists. Since the steady-state input is unity, we see that the dc gain is given by 
de gain = G(z)| =) = G(1) 
For the example above, G(1) = 1, which checks the time-response calculation. Since, for a con- 
stant input, the gain of the sampler/zero-order-hold is unity, the dc gain of the system of Fig. 4-1 
is also given by 
dc gain = limG,(s) 
Thus 
dc gain = limG(z) = lim G,(s) (4-14) 
I= sa 


This relationship gives us a relatively easy check on the calculation of G(z), since each term in 
(4-14) is easily evaluated. For example, in Example 4.3, 
— eT 


é l-e 1 
| = i =a + i = 1 SS = 
lim GQ) tin(2 =) 15 lim G(s) tim( 5) 


We will now investigate open-loop systems of other configurations. Consider the system 
of Fig. 4-3(a). In this system, there are two plants, and both G,(s) and G,(s) contain the transfer 
functions of the data holds. 
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i (s : ží C(s) 
E(s) E*(s) = G(s) A(s) A*(s) = G6) z 
(a) 

S *(s C(s) 
EO) Eo ig is >| G(s) > 
(b) 

S s ¥(s C(s) 
E(s) ~| Gs) A(s) AMS) Gls) x 


FIGURE 4-3 Open-loop sampled-data systems. 


Now, 


and thus 


Also, 


and thus 


Then, from (4-15) and (4-16), 


and the total transfer function is the product of the pulse transfer functions. 


(c) 


C(s) = Gy(s)A*(s) 


CR) = CAR) 


A(s) = G,(s)E*(s) 


AQ) = Gi(Z)E() 


CR) = Gi(Z)Gr(Z)E() 


(4-15) 


(4-16) 


(4-17) 


Consider now the system of Fig. 4-3(b). Of course, in this case, G2(s) would not contain a 
data-hold transfer function. Then 


and 


where 


C(s) = Gi(s)Go(s)E*(s) 


CR) = Gi Go(z)E() 


GGz) = glGi(s)Go(s)] 


(4-18) 


The bar above a product term indicates that the product must be performed in the s-domain 


before the z-transform is taken. In addition, note that 


4.4 Open-Loop Systems Containing Digital Filters 
GGz) # Gy(Z)Go(z) (4-19) 


that is, the z-transform of a product of functions is not equal to the product of the z-transforms 
of the functions. 
For the system of Fig. 4-3(c), 


C(s) = Ga(s)A*(s) = Gy(s)GE*(s) 
Thus 
C(z) = Go(z)Gy E(z) (4-20) 


For this system a transfer function cannot be written; that is, we cannot factor E(z) from G)E(z). 
E(z) contains the values of e(t) only at t = kT. But the signal a(t) in Fig. 4-3(c) is a function of 
all previous values of e(f), not just the values at sampling instants. Since 


A(s) = Gj(s)E(s) 


then, from the convolution property of the Laplace transform, 


a(t) = ec — t)e(t) dt (4-21) 
0 


and the dependency of a(t) on all previous value of e(t) is seen. In general, if the input to a 
sample-data system is applied directly to a continuous-time part of the system before being 
sampled, the z-transform of the output of the system cannot be expressed as a function of the 
z-transform of the input signal. We will see later that this type of system presents no special 
problems in analysis and design. 


4.4 OPEN-LOOP SYSTEMS CONTAINING DIGITAL FILTERS 


In the preceding section a transfer-function technique was developed for open-loop sampled-data 
systems. In this section this technique is extended to cover the case in which the open-loop 
sampled-data system contains a digital filter. 

In the system shown in Fig. 4-4, the A/D converter on the filter input converts the 
continuous-time signal e(t) to a number sequence {e(kT)}; the digital filter processes this num- 
ber sequence {e(kT)} and generates the output number sequence {m(kT)}, which in turn is 
converted to the continuous-time signal m(t) by the D/A converter. 

As was shown in Chapter 2, a digital filter that solves a linear difference equation with 
constant coefficients can be represented by a transfer function D(z), such that 


M(z) = DE) (4-22) 
Plant 
Els me Ms C(s) 
eae - A/D ———— Digital e D/A KU) >| G,(s) 6) 
e(t) e(kt) filter | m(kT) m(t) c(t) 


FIGURE 4-4 Open-loop system with a digital filter. 
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Plant 
E(s) E(z) M(z) r| MO) C(s) 
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Mee a 
y 
G(s) 


FIGURE 4-5 Model for the open-loop system. 


or, through the substitution z = eT, 


M*(s) = D*(s)E*(s) 


The D/A converter usually has an output data-hold register that gives the D/A the characteristics 
of a zero-order hold, and m(t) is of the form of e(t) in Fig. 3-3. Thus the Laplace transform of the 
signal m(t) can be expressed as, from (3-2), 

— _ gT 
M(s) = ~M *(s) 


Hence 
a2 1- gT 
C(s) = G,(s)M(s) = Gpl) — = M*(s) 


Then, from (4-22), 


1 = e7” 
C(s) = Gs) — De) 


z=" E*(s) (4-23) 


and we see that the filter and associated A/D and D/A converters can be represented in block- 
diagram form as shown in Fig. 4-5. Hence, from (4-23) or Fig. 4-5, 


_ —Ts 
CQ = 5] Gu = boro = G(QD(OE(2) (4-24) 


The digital computing device that implements the digital filter in Fig. 4-4 actually pro- 
cesses the values of the input data samples {e(kT)}. However, our model for the digital filter 
processes a sequence of impulse functions of weight {e(kT)}. Hence the complete model must be 
used as depicted in Fig. 4-5; that is, the combination of an ideal sampler, D(z), and a zero-order 
hold does accurately model the combination of the A/D, digital filter, and D/A. 


EXAMPLE 4.4 


Let us determine the step response of the system shown in Fig. 4-5. 
Suppose that the filter is described by the difference equation 


m(kT) = 2e(kT) — e[(k — 1)T] 
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and thus 
M(z _ 2z — 1 
D(z) = CET z! = 
E(z) Zz 
In addition, suppose that 
G,(s) : 
Pe stl 


Then, as shown in Example 4.3, 


$ | _1-et 
5| ss + 1) 2-e7 


Since E(z) = z/(z — 1), from (4-24) we obtain 
C(z) = DZGZ)E(z) 


- 21 ine z _@-)a-e*) 
z z—-egeľ]z-1 z- DE- & 4) 


By partial fractions, 


C@® Cza peT Dae 1 g€- 2 
z zz- De- z z-1 z-e7 
and 
ef? — 2 
aes ss! 2 
-1 z-e€ 
Since 
Tk = = fa n=i 
eee 0, ni 


the inverse z-transform of the first term in C(z) has a nonzero value only for n = 0, and thus 
cnT) =1+(e? —2e™, n=1,2,3,... 
and 
c0) =1—e7+ 1+ ee? -2=0 


Note that the value c(0) = 0 is obvious from inspection of C(z), since the order of the numerator is 
less than the order of the denominator. The verification of this example is considered in Problem 4-11. 


We can partially verify the response of the system of Example 4.4. Note that the final 
value of c(nT) is unity. From the final value property of the z-transform, we verify this value: 
22 NA ee 
lim c(nT) = lim(z — 1)C(z) = im! í X IF Mes 1 
n—> œo z—>l1 z=] z-eé 
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In addition, from (4-14), the dc gain of the system is given by 
2z—- 1 
Z 


1 
z=18 + 1 


dc gain = D(z) = 1 


Gs) 


a= S s=0 


Since in the steady state, the input is constant at a value of unity, the steady-state value of the 
output is 


lim c(nT) = (dc gain)(constant input) = (1X1) = 1 


which once again verifies the steady-state output. 
As a final point in this example, note that the output of the digital filter is given by 


M(z) = (2 — Z DEZ) = m(kT) = 2u(kT) — ul(k — 1)T] 


Hence in the steady state, the plant input is constant at a value of unity. It was shown in 
Example 4.3 that this condition results in a steady-state output of unity. 


4.5 THE MODIFIED z-TRANSFORM 


The analysis of open-loop systems, including those that contain digital filters, has been presented in 
preceding sections. However, this technique of analysis does not apply to systems containing ideal 
time delays. To analyze systems of this type, it is necessary to define the z-transform of a delayed 
time function. This transform is called the modified z-transform, which is developed in this section. 

The modified z-transform can be developed by considering a time function e(t) that is 
delayed by an amount AT, 0 < A < 1, that is, by considering e(t — AT)u(t — AT). The ordi- 
nary z-transform of the delayed time function is 


zlet — AT)u(t — AT)] = 3fE(s)e4"] = X enT — AT)z" (4-25) 
n=1 
Note that the sampling is not delayed; that is, the sampling instants are tf = 0, 7,27,... . The 


z-transform in (4-25) is called the delayed z-transform, and thus, by definition, the delayed 
z-transform of e(t) is 


El, A) = zlet — ATu(t — AT)] = 3[E(s) £74] (4-26) 


The delayed starred transform is also defined in (4-26), with the substitution z = e™. The 
delayed z-transform will now be illustrated by an example. 


EXAMPLE 4.5 


Find E(z,A), if A = 0.4, for e(t) = u(t). From (4-25), 


E(z,A) = g 0.6aT,, 1 +e 1.6aT, 2 +e 2.6aT, 3 fats 


=g 0.6aT, 11 +e al, 1 +e 2aT, 2 ates saN ] 
7 g 0.6aT 2-1 X g7 0.0aT 
afl -ar 


l=- e“z Z =E 


4.5 The Modified z-Transform 


e(t) A he(t— AT) u(t— AT) 


= 


t 0.47 
FIGURE 4-6 Example of the delayed z-transform. 


1 
1 
1 
1 
1 
T 2T 3T 4T t 


The sketches in Fig. 4-6 show both e(t) and e(t — AT). 
The modified z-transform is defined from the delayed z-transform. By definition, the mod- 
ified z-transform of a function is equal to the delayed z-transform with A replaced by 1 — m. 
Thus if we let E(z, m) be the modified z-transform of E(s), then, from (4-26), 
Ez, m) = Ek, A)| ,=1-m = aE)“ | a=1-m (4-27) 
From (4-25) and (4-27), 


E(z, m) = [e(T — AT)z! + e(2T — AT)z? 
+ e3T z AT)z* ee Ja=1—m (4-28) 
= e(mT)z! + e[(1 + mT] z2 + e[(2 + mT] + ++: 


with A = 1 — m. Two properties of the modified z-transform are 
Ez, 1) = EG, m)|m=1 = E@ — e(0) (4-29) 
and 
E(z, 0) = EG, m)|m=o = 2 'E@) (4-30) 


The value m = 1 denotes no delay [but e(0) does not appear in (4-28)], and the value m = 0 
denotes a delay of one sample period. 


EXAMPLE 4.6 


It is desired to find the modified z-transform of e(t) = £”. From (4-28), 


E(z, m) =€ mT, 1 +e +m, 2 +e Q+m)T, 3 E ens 


= e "Tz tele t+ ete tt eee | 
7 ets 1 B er 
l-e'! z-e” 
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e(t) h he(t—AT) u(t—AT) 


w 
t 


FIGURE 4-7 Example of the modified z-transform. 


A sketch of the time functions is given in Fig. 4-7. 


The ordinary z-transform tables do not apply to the modified z-transform. Instead, spe- 
cial tables must be derived. These tables are obtained by the following development. One can 
express the modified z-transform of a function E(s) in the following manner, from the develop- 
ment in Appendix III. 


E(z, m) = 3[E(s)€ "| A-1-m = 3[E(s) ©") = z'as) e] (4-31) 


Now Jim NE(A)e”™ is zero in the second integral in (A3-7) (see Fig. A3-2), and thus (3-10) 
applies. Then, from (3-10) and (4-31), 


E(z,m) = z | X, residues of E)E” —— zy (4-32) 
poles of l-z e 
EN 
Also, from (3-11), 
1 č . 
E*(s, m) = F >= E(s + jnw je ME tine sT (4-33) 


provided that e(t — AT) is continuous at all sampling instants. Modified z-transform tables are 
included with the ordinary z-transform tables in Appendix VI. 

A useful property of the modified z-transform will now be stated. Since the modified 
z-transform is the ordinary z-transform of a shifted function, the theorems of the ordinary 
z-transform derived in Chapter 2 may be applied to the modified z-transform, if care is exercised. 
In particular, the shifting theorem applies directly. 

Let 3,,[ * ] indicate the modified z-transform; that is, 


smlE(S)] = EC, m) = gml€*PE()] | a= 1m (4-34) 
Then, by the shifting theorem, for k a positive integer, 


aml EO] = Z “znl E] = zE, m) (4-35) 


4.6 Systems with Time Delays 


EXAMPLE 4.7 


We wish to find the modified z-transform of the function e(t) = t. It is well known that 
E(s) = 1/ s*. This function has a pole of order 2 at s = 0. Therefore, the modified z-transform 
can be obtained from (4-32) as [see (2-34)] 
T d g” 
m a, 

ent Larl 1 — z'e™ J,=0 


mel _ ze! )mTe"™ — el" -Tz !eT) 


L a 7 rey a, 
4) mtd: = z’) + =] 
=z 2 
L d-z-) 
_ mlz - 1) +T 


-17 


which is verified in the table in Appendix VI. 


4.6 SYSTEMS WITH TIME DELAYS 


The modified z-transform may be used to determine the pulse transfer functions of discrete-time 
systems containing ideal time delays. To illustrate this, consider the system of Fig. 4-8, which 
has an ideal time delay of tọ seconds. For this system, 


C(s) = G(s)eE*(s) (4-36) 
Thus 
Cz) = g[G(s)e ]E(z) (4-37) 
If we now let 
=kT+AT, O<A<1 (4-38) 


where k is a positive integer, then from (4-35), 
CQ) = 2 *sG(s)e A EQ) = "Gz, mE) (4-39) 


where m = 1 — A. The foregoing development will now be illustrated with an example. 


E(s) E*(s) Cs) 


=| G(s) c e 
T 


FIGURE 4-8 System with ideal time delay. 
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EXAMPLE 4.8 


In Fig. 4-8, let the input be a unit step, tg = 0.47, and 
Le 


CO at 


This system was considered in Example 4.3 with no delay. From (4-35) and the modified 
z-transform tables, 


—Ts 


| = ad = in| | 
s(s + 1) 


szija ente E] 
z z-De- 


l-e 
G(z, m) = m En 


Thus, since mT = T — AT = 0.6T, 


z(1 22 £267) + g 0-6T a =| 


Gi ee 
ae a C- DE- e” 


Since k = 0 in (4-39), C(z) is seen to be 


(1 — e6) + UOT — gT 
C@) = Ge, m)— = 


1 e- De- 


By the power-series method of Section 2.6, 
C(z) = a ee, e061) 771 Æ a pe e716? $ a = e 2 61)7-3 J enes 


From Example 4.3, the response of this system with no delay is c(nT) = 1 — ¢ ””. This response 
delayed by 0.47 is then 


eT) |rap = 1- e07 n=l (4-40) 


which checks the results of this example. 


The modified z-transform may also be used to determine the pulse transfer functions of dig- 
ital control systems in which the computation time of the digital computer cannot be neglected. 
As given in (2-4), an nth-order linear digital controller solves the difference equation 


m(k) = b,e(k) + b, jelk — 1) + +++ + belk- n) 


(4-41) 
— a,-ymk — 1)— +++ — agm(k — n) 


every T seconds. Let the time required for the digital controller to computer (4-41) be & sec- 
onds. Thus an input at t = 0 produces an output at f = tọ, an input at t = T produces an output 
at t = T + f, and so on. Hence the digital controller may be modeled as a digital controller 


4.6 Systems With Time Delays 


E v 
(8) = D(z) c o c 
T 
(a) 
Data hold 
— Controller ————————> and 
plant 
E(s) C(s) 
7 > D(z) =| gos >| G(s) > 


(b) 
FIGURE 4-9 Digital controller with nonzero computation time. 


without time delay, followed by an ideal time delay of f seconds, as shown in Fig. 4-9(a). An 
open-loop system containing this controller may be modeled as shown in Fig. 4-9(b). 
For this system, 
CR) = [GOE IDEC) (4-42) 
If we let 
bh =kT+AT, 0<A<1 (4-43) 
with k a positive integer, then from (4-39) and (4-42) we obtain 


C(z) = z*G(z, m)D(Z)E(z) (4-44) 


where m = 1 — A. 


EXAMPLE 4.9 


Consider the system of Fig. 4-10. 
This system is that of Example 4.4, with a computational delay added for the filter. The 
delay is 1 ms (f = 1077s) and T = 0.05 s. Thus, for this system, 


2z-1 


D(z) = 


mT + AT=T 


Filter 


1 

E(s)= = C(s) 
à >| 2z — 1 æj 0.0018 -—_e l-e® >| 1 = 
T=0.05s í z Sal 


FIGURE 4-10 System for Example 4.9. 
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or 
mT = T — AT = 0.05 — 0.001 = 0.049 
Then 
1-¢% z—-l 1 
G(z, m) = mE] = s | 
s(s + 1) JmT=0.049 Z S(s + 1) Imr=o.049 


From Example 4.8, 


— 1 j= g70049 + g 0.049 Z g 0.05 
aem = 2A iam j 


(2 — DE- e% 
Since the input is a unit step, then, from (4-44), 
C(z) = Gz, m)D(zZ)E(z) 


z— fe _ ee) + eo _ — = f z | 
z (Cn hear) z 


g= I 


O (2z = DEU — E) + (69 — 90055) 
az — De- © ©) 


4.7 NONSYNCHRONOUS SAMPLING 


In the preceding sections, simple open-loop systems and open-loop systems with digital filters 
and/or ideal time delays were considered. In this section open-loop systems with nonsynchro- 
nous sampling are analyzed. Nonsynchronous sampling can be defined by considering the sys- 
tem of Fig. 4-11. In this system both samplers operate at the same rate, but are not synchronous. 
We will now show that the output of this system can be derived using the modified z-transform. 

To develop a method of analysis for systems with nonsynchronous sampling, consider the 
sampler and data hold in Fig. 4-12(a). Here the sampler operates at hT, T + hT,2T + hT,3T + 
hT, ... , where 0 < h < 1. The data-hold output is as shown in Fig. 4-12(b), and may be 
expressed as 


a(t) = ehT)[u(t — hT) — ult — T — AT)|+ e(T + AT)[u(t — T — AT) 
— u(t — 2T = hT)] + e(2T + AD ue = 2T — hT) 


— u(t — 3T — hT) + ++ (4-45) 
G,(s) =| G(s) -————> 
T +200 T (20| 
samples at 0, samples at AT, 
T; 27, BT pos T+hT,2T+hT, 
T +hT,... 


FIGURE 4-11 System with nonsynchronous sampling. 


4.7 Nonsynchronous Sampling 


e(t) 


¢ BELTI 1 
e(t) Sampler and data-hold ZA) i f F 
——| operatesathT, T+hT, — ! i e(t) 
2T+hT,... ! ! 
l f | f | = 
hT T THhT 27 2T+hT 3T t 


(a) (b) 
FIGURE 4-12 Illustration of nonsynchronous sampling. 


Thus 

E g hTs —(T+hT)s g T+T) g CTtAT)s 

Es) = ear) = | + e(T + wn| = 

S S S 
-OT+AT)s — g-GT+hT)s 
+ eQT + un | $ 
S 

or 


= j= g Ts 
E(s) = ——— e"™[e(hT) + e(T + hT) ™ + e(2T + hT)?" + +--+ ] 
S 


ie" 
= ——— ee" e(hT)e® + e(T + hT) ?™ + e(2T + hT + +++ | 


Then, from (4-28), 


Fa =en ahi 
E(s) = a fe EZ, m) | m=n, z=" (4-46) 


Since 
El, m) = sE()E“" | a-1-m (4-47) 


we see from (4-46) that the sampler and data hold of Fig. 4-12 can be modeled as shown in 
Fig. 4-13, where the sampler operates at t = 0, T, 2T, .... Note that this model delays the input 
signal, samples the delayed signal, and then advances the delayed sampled signal, such that the 
total delay in the signal is zero. 

From the development above, we see that the system of Fig. 4-11, with nonsynchronous 
samplers, may be modeled as shown in Fig. 4-14. In Fig. 4-14, the samplers are synchronous and 
the system is of the form of that of Fig. 4-3(a). 


E(s) a E(s) 
— >} el —h)Ts >| els c e hTs | a a S 
T AY 


operates at 
OT; 2 +38 
FIGURE 4-13 Model of a sampler and data hold. 
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E(s) 
T G(s) 


y 


FIGURE 4-14 Model of the system of Figure 4-11. 


Now, in Fig. 4-14, 


and thus 


Also, 


yielding 


Then 


yielding 


A(s) A*(s) B*(s) 
eg WT Í — els >| e NTs 


| G(s) 


Both samplers operate at 0, T, 2T, ... 


A(s) = PTG (s)E*(s) 


A(z) = Gy(z, m) | m=n EQ) 


B*(s) = e7A*(s) 


B) = ZAZ) = ZEG, m)| m=n 


C(s) = £” G(s)B*(8) 


C(z) = Gz, m) | m=1-1 BC) 


From (4-49) and (4-50), we find C(z) to be given by 


C(z) = ZE)Gi(z, m) | m=n C, M) | m=1—n 


EXAMPLE 4.10 


C(s) 


(4-48) 


(4-49) 


(4-50) 


(4-51) 


We wish to find C(z) for the system of Fig. 4-15, which contains nonsynchronous sampling. 


Now 


xo =,[!]- 
(2) = 4), aT 


af 
E(s) T s 1- ets . i= e fs oe) 
R 2 

T=0.05 s seth T=0.05 s s 

operates at operates at 
0, 0.05, 0.01, 0.06, 

OL O43 se O11 O16 n 
FIGURE 4-15 System for Example 4.10. 


4.8 State-Variable Models 


For the system, T = 0.05 and hT = 0.01. From Example 4.8, 


ee rd 


G\(z,m) = sl s(s + 1) A (z — IXz-— e”) 


Then 


z(1 — 2091) + gl — = 


z— 1 
Gi, m) | mr=0.01 = z | C- Dee) 


Also, from the modified z-transform tables, 


1- g7 z— 1| mrz- mT +T 
Gz, m) = s | = | | 


s z (z — 1° 
or 
0.04z + 0.01 
GA(z, m) | m=1-h — 
z(íz — 1) 


Then, from the development above and (4-51), 


z lz- 12d — £? + e! — ¢ 919.047 + 0.01 
CR) =z 0.05 
=1] z z- 1I- a) zz — 1) 


2 O04 FOOD — Pe) + e! — eth] 
(z x DZ = eg 0.05) 


4.8 STATE-VARIABLE MODELS 


Thus far in this chapter we have discussed the analysis of open-loop sampled-data systems using 
the transfer-function approach. As was shown in Chapter 2, systems describable by a z-transform 
transfer function may also be modeled by discrete state equations. The state equations are of the 
form, from Section 2.8, 


x(k + 1) = Ax(k) + Bu(k) 


(4-52) 
y(k) = Cx(k) + Du(k) 


where x(k) is the state vector, u(k) is the input vector, and y(k) is the output vector. The state-variable 
techniques used in Chapter 2 may be employed here to find the state-variable models of open-loop 
sampled-data systems of the type discussed in this chapter. To obtain a state-variable model: 


1. Draw a simulation diagram from the z-transform transfer function. 
2. Label each time-delay output as a state variable. 
3. Write the state equations from the simulation diagram. 


This technique will now be illustrated with an example. 
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SSeS SSS SS SSS SS SS ea 


D(z) 


I 1 
I 1 
E(s) > 2z— 1 i i= es | 1 i Y(s) 
T z i sS stl 
l 
1 


beh oR ee ea 


elk) O f + —] x(k) 
— 4 1-7 >| z! 
= 4 yk) 


x(k) 


(b) 
FIGURE 4-16 System for Example 4.11. 


EXAMPLE 4.11 


Consider the system of Fig. 4-16(a), which is the system considered in Example 4.4. 
Here we are denoting the output as Y(s) instead of C(s), to prevent any notational confu- 
sion with the C matrix. From Example 4.4, 


aig ee! i 
co = |? € |-3 e 


s(s + 1) z=- e" 


and as is shown in Fig. 4-16(a), 


2z-1 


D(z) = 


A simulation diagram for this system is given in Fig. 4-16(b). Next each delay output is labeled 
as a State variable. Then, from this Fig. we write 


= c -T _ oo 
x(k+ iS j a kw re ~ N ew 


yk) = [1 O}x(k) 


4.9 REVIEW OF CONTINUOUS-TIME STATE VARIABLES 


Presented in the preceding section is a technique for obtaining a set of state equations describing 
a linear time-variant discrete-time system. This technique is based on transfer functions, and has 
two major disadvantages. One disadvantage can be illustrated by considering a simple mechani- 
cal system, the motion of a unit mass in a frictionless environment. For this system, 


4.9 Review of Continuous-Time State Variables 


d 
z9 = i) =f) (4-53) 


where x(t) is the displacement, or position, of the mass, and f(t) is the applied force. To obtain a 
continuous-time state-variable model, choose as state variables 


v,(t) = x(t) = position 


: ; : (4-54) 
v(t) = v(t) = x(t) = velocity 


where x(t) = dx(t)/dt. We denote the states of a continuous-time system as v(t), i = 1, 2. 
Then the state equations are 


ae eie 
v(t) 0 OJLv(t) 1 
Here we have chosen as state variables the position and the velocity of the mass. These variables 
may be considered to be the “natural” states (physical variables) of the system, and would be the 
desirable states to choose. If this simple system were a part of a sampled-data system, we can 
easily choose position as one of the states in the discrete state model, by letting position to be 
the output of the simple system. However, in taking the transfer-function approach to discrete 
state modeling, we would have difficulty in choosing velocity as the second state variable. Thus 
we lose the natural, and desirable, states of the system. Another disadvantage of the transfer- 
function approach is the difficulty in deriving the pulse transfer functions for high-order systems. 
A different approach for obtaining the discrete-time state model of a system is presented in 
the following section. This approach is based on the use of continuous-time state variables. Hence 
a brief presentation of the requisite theory of continuous-time state variables will be made here. 
As indicated in the example above of the motion of a mass, continuous-time state-variable 
equations for a linear-time-invariant system are of the form 


v(t) = A,v(t) + Bue) 


y(t) = CA) + Dou) (4-56) 


In this equation, v(t) are the states, u(t) are the inputs, y(t) are the outputs, and the matrices are 
subscripted to indicate continuous-time state equations. Nonsubscripted matrices will indicate 
discrete-time state equations. To illustrate continuous-time state equations, consider the follow- 
ing example. 


EXAMPLE 4.12 


It is desired to find a state model for the mechanical system of Fig. 4-17(a). 
Here M is mass, B is the damping factor for linear friction, and K is the stiffness factor for 
a linear spring. The equations for this system are [1] 


YO + By (t) + Ky (t) + Bly — y(t] = 0 
y(t) + BhA — pO] = ul) 
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—(B, + B2) 


yi) 
v(t) 


ïO 


u(t) 
(force) 
(a) (b) 
FIGURE 4-17 System for Example 4.12. 


The state variables are chosen as 


wd = yA; vA = yA 
vot) = WA; vÀ = yo) 
A flow graph for these equations is shown in Fig. 4-17(b). The transfer functions s™! represent 


integrators, and the output of each integrator is chosen as a state, as shown. Next the state equa- 
tions are written from the flow graph. 


0 1 0 O 0 
-K -(B;} +B) 0 k 0 
= v + u 
0 0 0 1 0 
0 B» 0 -B, 1 
7 f 0 0 ohy 
~~lo 0 1 0 


In Example 4.12, the state variables are positions and velocities. If the technique of drawing a 
flow graph from the system differential equations (written using physical laws) is used, the states 
chosen will be the natural states of the system. 
Consider now the state equations for a single-input, single-output, continuous-time system. 
v(t) = AVA + B.u(t) 


(4-57) 
y(t) = C(A + Dult) 


To obtain the solution of these equations, we will use the Laplace transform. For (4-57) [1], 


sV(s) — vO) = A.V(s) + B.U(s) (4-58) 


4.9 Review of Continuous-Time State Variables 
Solving for V(s) yields 
V(s) = [Is — AJ 1v0) + [Is — A.J 'B.U(s) (4-59) 
Define ®,(t) as 
A) = £1 {Is — Ay} (4-60) 
The matrix ®,(f) is called the state transition matrix for (4-57). The inverse Laplace transform 


of (4-59) is then 


v(t) = ®Av(O) + / P(t — T) B. u(a)dt (4-61) 
0 


The state transition matrix ®(f) can be calculated as given in (4-60). However, a different 
expression for ®,(t) may be derived. This expression is found by assuming ®,(f) in (4-61) to be 
an infinite series. 


®(t) = Ky + Kit + Ko’? + Kye + (4-62) 


where the K; are constant matrices. Choosing u(t) = 0, the substitution of (4-61), with ® (A 
given by (4-62), into (4-57) yields [1] 


£ Pp o0 A‘ tk 
D) = I + Art AH + BH +e) = SS 
2! 3! Fa ki 


(4-63) 
This expression for ®,(f) will prove to be useful in deriving discrete-time state models for 
sampled-data systems. 

A problem that often arises in determining state models of physical systems will now be 
discussed. This problem is illustrated by the system shown in Fig. 4-18(a). 


U(s) + : Y(s) ult) + as | x(t) 
OH” O ITE | 50 


(a) 


(b) 


u(t) + + | 7 x(t) y0) 
` Y 20) as 


FIGURE 4-18 System with an algebraic loop. 
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State equations, written from the simulation diagram of Fig. 4-18(b), are 
x) = —x(1) + uA — x9] 
yO) = xA) 


These equations are not in the standard format for state equations, since x(f) appears on the 
right-hand side of both the x(t) equation and the y(t) equation. The x(f) equation must be solved 
for x(2), resulting in 


x(t) = —0.5x(t) + 0.5u(t) 
and hence 
y(t) = —0.5x() + 0.5u(t) 


We now present a procedure for writing the state equations in the standard format for sys- 
tems of the type shown in Fig. 4-18. If we redraw the simulation diagram of Fig. 4-18(b) with 
the integrator omitted, Fig. 4-18(c) results. Now we write the equations for x(t) and y(f) in terms 
of the inputs in this diagram, x(t) and u(t). This technique is standard for writing state equations 
from simulation diagrams, although we usually do not redraw the diagram with the integrators 
removed. Applying Mason’s gain formula to the diagram in Fig. 4-18(c), we obtain the state 
equations 


i) = = pO #5 K uO = —O.5x(0) + O.Su(t 
-1 1 
WO = Ot ul) oS 


which is the desired result. 

The loop in Fig. 4-18(c) that does not contain an integrator is called an algebraic loop. We 
now present a second procedure for writing the state equations for systems with algebraic loops. 
The system equations are initially written as [2] 


x(t) = A,x(t) + A>x(t) + Bue) 
y(t) = CXA + CXA + Diu) 
Solving the first equation, we obtain 
x() = M- Aj] 'Aox() + [I — Al Bul) 
Then we substitute this equation into the one for y(t): 
y(t) = [CU _- ATA + ORKO + [CU — A'B, + Diu 


Thus we have the state equations for the system in standard form. 


4.10 DISCRETE-TIME STATE EQUATIONS 


A technique is developed in this section for determining the discrete state equations of a sam- 
pled-data system directly from the continuous-time state equations. In fact, the states of the 
continuous-time model become the states of the discrete model. Thus the natural states of the 
system are preserved. 


4.10 Discrete-time State Equations 


Us Os Y(s) 
9) >| l-e | MS) G,(s) cc 


T S 


FIGURE 4-19 Sampled-data system. 


To develop this technique, consider the state equations for the continuous-time portion of 
the system shown in Fig. 4-19. 


v(t) = AvA) + Bult) 


(4-64) 
y(t) = C(A) + Dult) 
As shown in Section 4.9, the solution to these equations is 
t 
v(t) = P(t — to)v(fo) + J P(t — 7)B.u(t)dt (4-65) 
to 
where the initial time is tg, and where, from (4-63), 
2 A(t — t)* 
®t — to) = So (4-66) 
m= k! 
To obtain the discrete model we evaluate (4-65) att = kT + T with t = kT, that is, 
kT+T 
wkT + T) = ®(T)v(kT) + u(kT) P (kT + T — 1)B.dt (4-67) 
kT 


Note that we have replaced u(t) with u(kT) since, during the time interval kT = t < kT + T, 
u(t) = u(kT). It is emphasized that this development is valid only if u(t) is the output of a 
zero-order hold. 

Compare (4-67) with the discrete state equations [see (4-52)] 


x(k + 1) = Ax(k) + Bu(k) 


(4-68) 
y(k) = Cx(k) + Duk) 
Thus, if we let 
x(kT) = v(kT) 
A = ®.(T) (4-69) 


kT+T 
B= f ® (kT + T — 1)B.dt 
kT 


we obtain the discrete state equations for the sampled-data system. Hence the discrete-system 
A and B matrices are given by (4-69). 
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The output equation in (4-64), when evaluated at t = kT, yields 


y(kT) = C.v(kT) + D.ulkT) 


(4-70) 
= C,x(kT) + D.ukT) 
Thus the discrete C and D matrices are equal to the continuous-time C, and D, matrices, 
respectively. 
The relationship for B can be simplified. In (4-69) in the equation for B, let kT — t = —o. 
Then this equation becomes 


T 
B=| | ær- odo B, (4-71) 
0 


The discrete system matrices A and B may be evaluated by finding ® (T) using the Laplace 
transform approach of (4-60). However, in general this approach is cumbersome. A more trac- 
table technique is to use a computer evaluation of ®,(T) in (4-63); that is, with t = T, (4-66) 
and (4-63) becomes 


T? 
OATH ATH + AE 4... (4-72) 
Since this is a convergent series, the series can usually be truncated with adequate resulting 
accuracy. 
The integral of (4-71), necessary for the computation of B, can also be evaluated using a 
series expansion. In (4-71), lett = T — o. Hence 


T 
[2.0 - om f ww dt) = [ woa 
0 


3 
=f (iranta aT o Jar (4-73) 
0 
T2 T? T4 
SWEA FAL +A — +... 
2! 3! 4! 
and, from (4-71) and (4-73), 
T? 
B= jrr ad eats le, (4-74) 


Comparing (4-72) with (4- 13), we see that the computer program used to evaluate ®.(T) may 
also be used to evaluate Jo o ®.(1)dt, by expanding the program somewhat. 

In the derivations above, only the single-input, single-output case was considered. For 
the multiple-input, multiple-output case, the results are the same, with D, and D now matrices. 
For the multiple-input case, each input must be the output of a zero-order hold. In certain practi- 
cal cases in which some of the inputs are not outputs of zero-order holds, the procedure above is 


4.10 Discrete-time State Equations 


still used. The resulting discrete model is reasonably accurate, provided that these inputs change 
slowly over any sample period. 
The derivations above will now be illustrated by an example. 


EXAMPLE 4.13 


For the sampled-data system of Fig. 4-19, let T = 0.1 s and 


10 


OO ED 


For example, this plant could be a servomotor of the type described in Chapter 1. A continuous- 
time state-variable model of this system is from Fig. 4-20(a), 


.. _ | 0 1 0 
x(t) = r the + Pico 
yt) = [1 OH 


For this example, since the system is second order, ®,(f) will be found. 


PA) = L"'[[sl — AT") 


1 1 
ap -1 [=s s s(s+1) 
0 stil 1 
0 
stl 


Also, 
T —T71T =f 
+ T T— 1+ 
[eh SSE TIE 
0 O =e 0 0 l-e 
Then 
1 0.0952 
A = (T) t=01 = 
T)|7=0.1 p 0.905 | 
and 


$ 0.1 0.00484 ]f 0 
B= ® .(1)dt |B. = 
P 0 0.0952 |[ 10 


Ee 
0.952 
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U(s) + X,(s) Y(s) 
> 10 gl = y > 
X,(s) 
(a) 
>| 0.0484 
u(k) + x(k) , x(k) 
0.952 = T >| 0.0952 > >| T > 
+ + xW 
0.905 je 
(b) 


FIGURE 4-20 Simulation diagram for the system of Example 4.13. 


Hence the discrete state equations are 


f n] p 
x(k + 1) = x(k) + 


l% 
0 0.905 0.952 


yk) = [1 O}x(k) 


A simulation diagram of this model is shown in Fig. 4-20(b). Fig. 4-20(a) is the simulation dia- 
gram of the analog plant. Even though the states, the input, and the output of the two diagrams in 
Fig. 4-20 are equal at the sampling instants, the two diagrams bear no resemblance to each other. 
In general, the two simulation diagrams for such a system are not similar. 


The discrete matrices in the example above may also be calculated by computer. For 
three-significant-Fig. accuracy, three terms in the series expansion of ®,(f) [see (4-72)] are 
required. Five terms in the series expansion yield six-significant-Fig. accuracy. 


4.11 PRACTICAL CALCULATIONS 


As stated in the preceding section, all calculations required to develop the discrete model of an 
analog plant may be performed by computer. Calculation by computer is required for high-order 
systems, and is preferred for low-order systems to reduce errors. 

We will now list the steps necessary for the calculations. 


1. Derive the state model for the analog part of the system, in the form 


x(t) = A.x(t) + B.u(2) 


y(t) = C.x(4) + DuA ie 
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2. If the transfer function of the analog part of the system is required, calculate [1, 3] 
G,(s) = C,.[sl — AJ'B, + D, (4-76) 
3. Calculate the discrete matrices of the analog part of the system [Eq. (4-74)] 
A=I+AT+ A2T?/2 +- 
B = (IT + A,T?/2! + TB! + +++ )B. (4-77) 
C=C, D = D: 
4. Calculate the pulse transfer function [see (2-84)] using [3] 
G(z) = CI- AJ'B + D (4-78) 


The calculations required in steps 2, 3, and 4 may be implemented in MATLAB by the 
statements 


2. [numc,denc] = ss2tf(Ac,Bc,Cc,Dc) 
3. [A,B] = c2d(Ac,Bc,T) 
4. [numz,denz] = ss2tf(A,B,C,D) 


In these statements, numc are the numerator-polynomial coefficients of G,(s), and denc are those 
of the denominator. Defined in a like manner are numz and denz for G(z). 

Note that these procedures give the analog transfer function, the discrete state model, and 
the pulse transfer function. We do not directly use the z-transform tables in any of the steps; all 
steps are performed on the computer. However, we must, by some procedure, derive the analog 
state model. An example is now given to illustrate these procedures. 


EXAMPLE 4.14 


Consider again the system of Example 4.13. A MATLAB program that calculates the discrete 
state matrices A, B, C, and D, and the plant transfer function G(z) = numz/denz is given by 


Ac 
Be 


A,B] = c2d(Ac,Bc,T) 
numz,denz] = ss2tf(A,B,C,D) 


E 
D 
T 
[ 
[ 
Gz = tf (numz,denz,T) 


For certain systems, the direct programming of (4-74) and (4-77) yields unacceptable 
numerical errors. For these cases the discrete A and B matrices must be evaluated using different 
algorithms [4—6]. 
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4.12 SUMMARY 


In this chapter we have examined various aspects of open-loop discrete-time systems. In par- 
ticular we discussed the starred transform and showed that it possesses the properties of the 
z-transform defined in Chapter 2. Next, the starred transform was used to find the pulse trans- 
fer function of open-loop systems. The pulse transfer function was extended to the analysis of 
open-loop systems containing digital filters. In order to analyze systems containing ideal time 
delays, the modified z-transform and its properties were derived. Then techniques for finding 
discrete state-variable models of open-loop sampled-data systems were presented. These devel- 
opments form the basis for the computer calculations of discrete state models and the pulse 
transfer function. The foundation built in this chapter for open-loop systems will serve as a basis 
for presenting the analysis of closed-loop discrete-time systems in Chapter 5. 
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(a) Show that a pole of E(s) in the left half-plane transforms into a pole of E(z) inside the unit circle. 


(b) Show that a pole of E(s) on the imaginary axis transforms into a pole of E(z) on the unit circle. 
(c) Show that a pole of E(s) in the right half-plane transforms into a pole of E(z) outside the unit circle. 


Let T = 0.08 s and 


E(s) = 


(a) Without calculating E(z), find its poles. 
(b) Give the rule that you used in part (a). 


s+4 


(c) Verify the results of part (a) by calculating E(z). 


(d) Compare the zero of E(z) with that of E(s). 


(s + 2)(s — 2) 


(e) The poles of E(z) are determined by those of E(s). Does an equivalent rule exist for zeros? 


4.2-3. 


4.2-4. 
4.3-1. 


4.3-2. 
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Find the z-transform of the following functions, using z-transform tables. Compare the pole-zero locations 
of E(z) in the z-plane with those of E(s) and E*(s) in the s-plane (see Problems 3.4-1). Let T = 0.5 s. 


w EG) = ——? —_ D Be) = 227 

A PN eee EE Uf aes 
s(s + 1) ss + 1) 
st+3s+2 2 

© EO ee Ny + 2) a ae a a 


(g) Verify any partial-fraction expansions required, using MATLAB. 
Repeat Problem 4.2-3 with T = 0.01 s. 
Find the z-transforms of the following functions: 


diis gape: 
355 + 1)’ ` 


(0.85s + 1)(1 — es) 
(b) E(s) = , T=05s 
0.8s(s + 0.5) 


(a) Find the system response at the sampling instants to a unit step input for the system of Fig. P4.3-2. 
Plot c(nT) versus time. 

(b) Verify your results of (a) by determining the input to the plant, m(t), and then calculating c(t) by 
continuous-time techniques. 

(c) Find the steady-state gain for a constant input (dc gain), from both the pulse transfer function and from 
the plant transfer function. 

(d) Is the gain in part (c) obvious from the results of parts (a) and (b)? Why? 


Zero-order 
i hold Plant 
E()= 5 toe | M6) 25 C(s) 
| aa > 
T=0558 s s+0.2 


FIGURE P4.3-2 System for Problem 4.3-2. 


4.3-3. 


4.3-4. 


Repeat Problem 4.3-2 for the case that T = 0.2 s and the plant transfer function is given by: 


_ 8 
(a) G,(s) = are 


(b) G(s) = Side a 


Verify each G(z) by computer. 


(a) Find the conditions on a transfer function G(z) such that its de gain is zero. Prove your result. 
(b) For 


—Ts 


| =e 
Gz) = T] 
find the conditions of G,(s) such that the de gain of G(z) is zero. Prove your result. 
(c) Normally, a pole at the origin in the s-plane transforms into a pole at z = 1 in the z-plane. The function 
in the brackets in part (b) has a pole at the origin in the s-plane. Why does this pole not transform into 
a pole atz = 1? 


158 Chapter 4 * Open-Loop Discrete-Time Systems 


(d) Find the conditions on G(z) such that its de gain is unbounded. Prove your result. 


(e) For G(z) as given in part (b), find the conditions of G,(s) such that the de gain of G(z) is unbounded. 
Prove your result. 


4.3-5. Find the system response at the sampling instants to a unit-step input for the system of Fig. P4.3-5. 


al 
E(s)= 1 l—-e 59 C(s) 
| >) > 


| 
etl T=1s sS (s+ 1)(s +3) 


FIG. P4.3-5 System for Problem 4.3-5. 


4.3-6. (a) Find the output c(kT) for the system of Fig. P4.3-6, for e(t) equal to a unit-step function. 
(b) What is the effect on c(kT) of the sampler and data hold in the upper path? Why? 
(c) Sketch the unit-step response c(t) of the system of Fig. P4.3-6. This sketch can be made without math- 
ematically solving for C(s). 
(d) Repeat part (c) for the case that the sampler and data hold in the upper path is removed. 


a 
a 


E(s) A C(s) 
| 


Ay 


T 
FIG. P4.3-6 System for Problem 4.3-6. 


4.3-7. (a) Express each C(s) and C(z) as functions of the input for the systems of Fig. P4.3-7. 
(b) List those transfer functions in Fig. P4.3-7 that contain the transfer function of a data hold. 


— < Sy 1m ao 


T 
E(s) 6g C(s) 
—_—_* 
+ 
— G(s) ~~~] Gals) 
T 
(a) 
— w] 
Es s 
Eis) | G(s) L4 GAs) | Co) 
T 
(b) 


FIGURE P4.3-7 Systems for Problem 4.3-7. 
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G(s) 


G,(s) Digital 
filter 


E(s) C(s) 


AID | D(z) >| D/A 


(c) 


FIGURE P4.3-7 (continued) 


4.3-8. 


1 1 
I 1 
l 1 
l bd 1 
M s toe g Z 200 On d a a] 
T er i O5s+1 s i 100 
l 1 
l 1 
1 1 


Shown in Fig. P4.3-8 is the block diagram of one joint of a robot arm. This system is described in Problem 
1.5-4. The signal M(s) is the sampler input, E,(s) is the servomotor input voltage, @,,(s) is the motor shaft 
angle, and the output @,(s) is the angle of the arm. 

(a) Suppose that the sampling-and-data-reconstruction process is implemented with an analog-to-dig- 
ital converter (A/D) and a digital-to-analog converter. Redraw Fig. P4.3-8 showing the A/D and 
the D/A. 

(b) Suppose that the units of e,(f) are volts, and of ©,,(¢) are rpm. The servomotor is rated at 24 V (the volt- 
age e,(t) should be less than or equal to 24 V in magnitude). Commercially available D/As are usually 
rated with output voltage ranges of +5 V, +10 V, 0 to 5 V, 0 to 10 V, or 0 to 20 V. If the gain of the 
power amplifier is 2.4, what should be the rated voltage of the D/A? Why? 

(c) Derive the analog transfer function @,(s)/E,(s). 

(d) With K = 2.4 and T = 0.1 s, derive the pulse transfer function @,(z)/M(z). 

(e) Derive the steady-state output for m(t) constant. Justify this value from the motor characteristics. 

(f) Verify the results of part (d) by computer. 


( ieeiealiantantaniept an lantenionimntantaniontaxianteniont manta 


Power 
Servomotor 


amplifier 


v2 


boa eae eee ee ee ee ee ee 


FIG. P4.3-8 Model of robot arm joint. 


4.3-9 


Fig. P4.3-9 illustrates a thermal stress chamber. This system is described in Problem 1.6-1. The system 

output c(t) is the chamber temperature in degrees Celsius, and the control-voltage input m(t) operates a 

valve on a steam line. The sensor is based on a thermistor, which is a temperature-sensitive resistor. The 

disturbance input d(t) models the opening of the door into the chamber. With the door closed, d(t) = 0; if 
the door is opened at t = tọ, d(t) = u(t — tọ), a unit-step function. 

(a) Suppose that the sampling-and-data-reconstruction process is implemented with an analog-to-digital 
converter (A/D) and a digital-to-analog converter (D/A). Redraw Fig. P4.3-9 showing the A/D and the 
D/A. 

(b) Derive the transfer function C(z)/E(z). 

(c) A constant voltage of e(t) = 10 V is applied for a long period. Find the steady-state temperature of 
the chamber, with the door closed. Note that this problem can be solved without knowing the sample 
period T. 


160 Chapter 4 * Open-Loop Discrete-Time Systems 


(d) Find the steady-state effect on the chamber temperature of leaving the door open. 
(e) Find the expression for C(s) as a function of the Laplace-transform variable s, the control input, and the 
disturbance input. The z-transform variable z cannot appear in this expression. 


Chamber 
fo ke ee ge oe 
| I 
D(s) 2.5 l 
ee 
d(t) i s+0.5 } 
i i 
| — I 
E(s) pa L-g M(s) | J 2.5 a ! Temperature (° a 
: i s+0.5 f 
e(t) T s m(t) l | c(t) 
| | 
Sensor 
Voltage 
< 0.04 


FIGURE P4.3-9 Block diagram for a thermal test chamber. 


4.3-10. Given in Fig. P4.3-10 is the block diagram of a rigid-body satellite. The control signal is the voltage e(t) 
. The zero-order hold output m(t) is converted into a torque t(f) by an amplifier and the thrusters (see 
Section 1.4). The system output is the attitude angle 6(¢) of the satellite. 
(a) Find the transfer function @(z)/E(z). 
(b) Use the results of part (a) to find the system’s unit-step response, that is, the response with e(t) = u(t). 
(c) Sketch the zero-order-hold output m(t) in (b). 
(d) Use m(® in part (c) to find c(t) = £7! [KM(s) / Js]. 
(e) In part (d), evaluate c(kT ). This response should equal that found in part (b). 


Amplifier and 
thrusters Sate/lite 
E(s) 7 t—et | Mos) 2 T(s) l O(s) 
e(t) T s m(t) a(t) Js ZO) 
Torque 


FIG. P4.3-10 Block diagram for a satellite. 


4.3-11. The antenna positioning system described in Section 1.5 and Problem 1.5-1 is depicted in Fig. P4.3-11. In 
this problem we consider the yaw angle control system, where @(f) is the yaw angle. The angle sensor (a 
digital shaft encoder and the data hold) yields v,(kT) = [0.4 0(kT)], where the units of v,(f) are volts and 
Q(t) are degrees. The sample period is T = 0.05 s. 

(a) Find the transfer function @(z)/E(z). 

(b) The yaw angle is initially zero. The input voltage e(t) is set equal to 10 V at t = 0, and is zero at each 
sample period thereafter. Find the steady-state value of the yaw angle. 

(c) Note that in part (b), the coefficients in the partial-fraction expansion add to zero. Why does this occur? 

(d) The input voltage e(t) is set to a constant value. Without solving mathematically, give a description of 
the system response. 
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Motor, gears, 


Amplifier and pedestal 
Es 7 Ms Os 
a a ee ~| 20 = 
elt) T sS m(t) s? + 6s (C9) 
P ee 
1 
Sensor 
| 1 
Vols)! a I-et ! 
Vo(t) S T ' 
| j 
| 


FIGURE P4.3-11 Block diagram for an antenna control system. 


4.4-1. 


(e) Suppose in part (d) that you are observing the antenna. Describe what you would see. 

Example 4.3 calculates the step response of the system in Fig. 4-2. Example 4.4 calculates the step response 

of the same system preceded by a digital filter with the transfer function D(z) = (2 — z~’). This system is 

shown in Fig. P4.4-1. 

(a) Solve for the output of the digital filter m(kT). 

(b) Let the response in Example 4.3 be denoted as c,(kT ). Use the results in part (a) to express the output 
c(kT ) in Fig. P4.4-1 as a function of c,(AT). 

(c) Use the response c,(AT) calculated in Example 4.3 and the results in part (b) to find the output c(AT ) in 
Fig. P4.4-1. This result should be the same as in Example 4.4. 

(d) Use the response C;(z) calculated in Example 4.3 and the result in part (b) to find the output C(z) in 
Fig. P4.4-1. This result should be the same as in Example 4.4. 


De) ae 
E(s) E*(s) ae M(z) Jise” n I wa 
e(t) T e(kT) m(kT) sS SHI c(t) 


FIG. P4.4-1 System for Problem 4.4-1. 


4.4-2. 


Consider the hardware depicted in Fig. P4.4-2. The transfer function of the digital controller implemented 
in the computer is given by 


DG) = 4.5(z — 0.90) 
z— 0.85 
The input voltage rating of the analog-to-digital converter is +10 V and the output voltage rating of the 
digital-to-analog converter is also +10 V. 
(a) Calculate the dc gain of the controller. 
(b) State exactly how you would verify, using the hardware, the value calculated in part (a). Give the equip- 
ment required, the required settings on the equipment, and the expected measurements. 


Digital 
Voltage +10 V computer +10V_ Voltage 
in out 
——+| A/D c D(z) =| D/A > 


FIGURE P4.4-2 Hardware configuration for Problem 4.4-2. 
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4.4-3. For the system of Fig. P4.4-3, the filter solves the difference equation 
mk) = 0.8m(k — 1) + 0.le(k) 


The sampling rate is 1 Hz and the plant transfer function is given by 


meer) 


(a) Find the system transfer function C(z)/E(z). 

(b) Find the system dc gain from the results of part (a). 

(c) Verify the results of part (b) by finding the dc gain of the filter using D(z) and that of the plant using 
G(s). 

(d) Use the results of part (b) to find the steady-state value of the unit-step response. 

(e) Verify the results of part (d) by calculating c(kT) for a unit-step input. 

(f) Note that in part (e), the coefficients in the partial-fraction expansion add to zero. Why does this occur? 


Digital 
filter Plant 
E(s) M(z) C(s) 
>, A/D >| D(z) > D/A >| G,(s) > 
e(kT ) m(kT ) 


FIGURE P4.4-3 System for Problems 4.4-3 and 4.4-4. 


4.4-4. Repeat Problem 4.4-3 for the case that the filter solves the difference equation 


m(k + 1) = 0.5e(k + 1) — (0.5)(0.8)e(k) + 0.485m(k), 


the sampling rate is 10 Hz, and the plant transfer function is given by 


5 


GS) = Gr pe + Dd 


4.4-5. Consider the system of Fig. P4.4-5. The filter transfer function is D(z). 
(a) Express C(z) as a function of E. 
(b) A discrete state model of this system does not exist. Why? 
(c) What assumptions concerning e(t) must be made in order to derive an approximate discrete state 
model? 


E(s igi 
(s) „| Digital 


G(s) C(s) 
= G(s =| A/D filter = 


y 


=| D/A G(s) 


FIGURE P4.4-5 System for Problem 4.4-5. 


4.4-6. Consider again the system of Fig. P4.4-5. Add a sampler for E(s) at the input. Given 


— 0.5 
Dj = É G(s) = 


S 
G\(s) = -E 
i(s) s+ 10 z-1 s + 95 + 23 


find c(kT) for a unit-step input with T = 0.5 s. Is this a good choice for the sampling interval? If not, what 
sampling rate would you recommend. Find c(kT) at your recommended sampling rate and plot both step 
responses using MATLAB. 
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4.5-1. Find the modified z-transform of the following functions: 
(a) EG) = ——" b) E(s) = ———~ 
i Pole aN ets) Sa eed) 
© EQ) =E @ Es) = ** 
c EESTE s) = = 
s(s + 1) ss + 1) 
vs +5s+6 2 
E(s) = ——— ~ E(s) = 
(e) Els) GFARE (f) E(s) = 3 rere 
4.5-2. Find the z-transform of the following functions. The results of Problem 4.5-1 may be useful. 
20¢7 0375 —0.6Ts 
EG) ="S- ee b) E(s) = ———— 
@ EO = Ce +5) DE 
i ; KR j 5 +271 Its @ a j s+ Je 027s 
€ s) = — s) = > 
s(s + 1) s(s + 1) 
7 i 7 (s + 5s + 6)e 037 © H ) E —0.75Ts 
NS) ss + 4s + 5) ame Day Tae 
4.5-3. Find the modified z-transform of the following functions: 
(a) Els) = : b) Els) = ——G 
: (s + 1)(s + 2s + 3) s(s + 2}? 
mys Ee 
c s) = —— s) = 
s(s + 2)° Xs + 1p 
© Els) s+ 2s + 3 (f) E(s) 2s + 7 
e s) = s) = 
s(s + 2)°(s + 4) (s? + 29 + 5)(s + 3) 
4.5-4. Find the z-transform of the following functions. The results of Problem 4.5-3 may be useful. 
6e 0375 —0.6Ts 
a) E(s) = b) Els) = ——— 
@ EC) (s + Ds + 2)(s + 3) PES) s(s + 2° 
) KK j s2 25 Jel ITs a) K j (s fe 2) e2275 
c s) = s) = 
s(s + 2)? ss + 1)? 
Se + 2s +3 Qs + e?n" 
(e) Els) = ; () Bs) = 
s(s + 2)°(s + 4) (s4 + 2s + 5)(s + 3) 
4.6-1. Generally, a temperature control system is modeled more accurately if an ideal time delay is added to the 
plant. Suppose that in the thermal test chamber of Problem 4.3-9, the plant transfer function is given by 
CO) -.» Ve 
G(s) = — = 
WS) = Fe) 5405 


Hence the plant has a 2-s time delay before its response to an input. For this problem, let the sample period 

T= 0.6s. 

(a) Find the unit step response for the system of Fig. P4.3-9; that is, find c(kT) with e(t) = u(t) and 
d(t) = 0, and with no delay. 

(b) Repeat part (a), with the 2-s time delay included in G,(s), as given above. 
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(c) Solve for c(t) with no delay, using the Laplace transform and the plant input m(t). 


(d) Find c(t) for the delay included, using the results of part (c). 
(e) Show that in part (c), c(t) evaluated at t = kT yields c(AT) in part (a). 
(£) Show that in part (d), c(t) evaluated at t = kT yields c(kT) in part (b). 


4.6-2. For the thermal test chamber of Problems 4.3-9 and 4.6-1, let T = 0.6 s. Suppose that a proportional-integral 


(PI) digital controller with the transfer function 


0.1z 
z=ł 


D(z) = 1.2 + 


is inserted between the sampler and the zero-order hold in Fig. P4.3-9. 


(a) With d(t) = 0 and e(t) = u(t), solve for c(kT), with the time delay of 2 s omitted. 
(b) Explain what happens to the temperature in the chamber in part (a). Is this result physically possible? 
(c) In Fig. P4.3-9, calculate m(kT), the signal that controls the valve in the steam line, for the inputs of part 


(a). 


(d) Considering the physical characteristics of a valve, what happens to the temperature in the physical test 


chamber? 


4.6-3. For Problem 4.4-6, assume that the total computational delay in D(z) plus the plant delay totals 3.4T sec- 


onds. Repeat the problem under these new conditions. 
4.8-1. Find a discrete-state-variable representation for the system shown in Fig. P4.8-1. 


Digital filter 


E(s) 7 


data hold 


FIGURE P4.8-1 System for Problem 4.8-1. 


A discrete-state-variable description of the continuous-time system is given by 


09 1 2 0 
x(k+1)=| 0 09 0 [x(k +] 1 |m(k 
-1 0 05 1 


yk) = [1 1.5 2.3)x(k) 


4.8-2. Repeat Problem 4.8-1 after replacing the digital filter with this transfer function: 


z— 0.5 


DE) re Sie D 


4.9-1. (a) The model of a continuous-time system with algebraic loops is given as 


X(t) = —2x() + 0.5x(1) + 3u(A) 
y(t) = x(t) + 4u(t) 
Derive the state equations for this system. 
(b) Repeat part (a) for the system described by 
AA = xlt + 2%,(1) + uy 
HA = =À = mO — nO + 1 + w(t 
yf) = X(t) 


Use the matrix technique of Section 4.9. 


Continuous Y(s) 
plant and > 


Problems 165 


(c) Verify the results of part (b) by solving the given equations for x,(f) and X(f) in the standard 
state-variable format. 
4.9-2. The model of a continuous-time system with algebraic loops is given as 


yO) = xy) + 2%() + ult) 

WA = HA — mo) — 4 + yO + wd) 
LOA = =A — 33) — A + xA + ml 
yt) = xl) 


Derive the state equations for this system. Use the matrix technique of Section 4.9. Verify the results by 
solving the given equations for x(t), x2(¢), and x3(f) in the standard state-variable format. 
4.10-1. Consider the system of Fig. P4.10-1. The plant is described by the first-order differential equation 


a + 0.04y(t) = 0.2m(t) 


Let T= 2s. 

(a) Find the system transfer function ¥(z)/E(z). 

(b) Draw a discrete simulation diagram, using the results of part (a), and give the state equations for this 
diagram. 

(c) Draw a continuous-time simulation diagram for G,(s), and given the state equations for this 
diagram. 

(d) Use the state-variable model of part (c) to find a discrete state model for the system. The state vectors 
of the discrete system and the continuous-time system are to be the same. 

(e) Draw a simulation diagram for the discrete state model in part (d). 

(f) Use Mason’s gain formula to find the transfer function in part (e), which must be the same as that found 
in part (a). 

Verify the results in parts (a) and (d) by computer. 


Plant 
Ms) Y(s) 


>| l-e |__| G,(s) a a 


Ẹ S 


E(s) 


FIGURE P4.10-1 System for Problem 4.10-1. 


4.10-2. Repeat Problem 4.10-1 for the plant described by the second-order differential equation for T = 2 


d’y(t dy(t 
a + 0.25 0 
dt dt 


+ 0.005y(t) = 0.2m(1) 


4.10-3. Consider the robot arm system of Fig. P4.3-8. Let T = 0.1 s. 

(a) Find the system transfer function @,(z)/M(z). 

(b) Draw a discrete simulation diagram, using the results of part (a), and give the state equations for this 
diagram. 

(c) Draw a continuous-time simulation diagram for amplifier-servomotor-gears system and give the state 
equations for this diagram. 

(d) Use the state-variable model of part (c) to find a discrete state model for the system. The states of the 
discrete systems are the same as those of the continuous-time system. 

(e) Draw a simulation diagram for the discrete state model in part (d). 

(f) Use Mason’s gain formula to find the transfer function in part (e), which must be the same as found in 


part (a). 
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4.10-5. 


4.10-6. 


4.10-7. 
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Consider the thermal stress chamber depicted in Fig. P4.3-9. Let T = 0.6 s. Ignore the disturbance input 

d(t) for this problem. 

(a) Find the system transfer function C(z)/E(z). 

(b) Draw a discrete simulation diagram, using the results of part (a), and give the state equations for this 
diagram. 

(c) Draw a continuous-time simulation diagram for the plant, and give the state equations for this diagram. 

(d) Use the state-variable model of part (c) to find a discrete state model for the system. The states of the 
discrete systems are the same as those of the continuous-time system. 

(e) Draw a simulation diagram for the discrete state model in part (d). 

(f) Use Mason’s gain formula to find the transfer function in part (e), which must be the same as that found 
in part (a). 

Repeat Problem 4.10-4 for the satellite system of Fig. P4.3-10, with T = 1 s. In part (a), the required trans- 

fer function is O(z)/E(z). 

Repeat Problem 4.10-4 for the antenna system of Fig. P4.3-11, with T = 0.05 s. In part (a), the required 

transfer function is @(z)/E(z). 

Consider a proportional-integral (PI) digital controller with the transfer function 


0.1z 


D(z) = 1.2 + 


This controller is placed in the designated system between the sampler and data hold. Find a discrete state 

model of: 

(a) The system of Problem 4.10-1. 

(b) The satellite system of Problem 4.10-5. 

(c) In parts (a) and (b), use MATLAB to verify the results by calculating the system transfer functions 
from the state models. 


Closed-Loop Systems 


5.1 INTRODUCTION 


In Chapter 4 a technique was developed for determining the output functions of open-loop dis- 
crete linear time-invariant (LTI) systems. In this chapter we extend these techniques to determine 
the output functions of closed-loop discrete-time LTI systems. Also presented is a technique for 
developing state-variable models for closed-loop discrete-time systems. As a matter of conve- 
nience, we often more concisely refer to discrete-time systems as simply discrete systems. 


5.2 PRELIMINARY CONCEPTS 


Before considering simple closed-loop systems, open-loop systems with cascaded plants will be 
reviewed. As shown in Chapter 4, the output for the system of Fig. 5-1(a) is 


C) = GRGE) (5-1) 
and that of Fig. 5-1(b) is 
C(z) = GiGC)ER) (5-2) 
For the system of Fig. 5-1(c), 
C(s) = Gy(s)A*(s) = G(s)G,E*(s) (5-3) 


and 


C) = Gy(2)G,E) (5-4) 
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E(s) C(s) 
=| G(s) >) G(s) 5 
T T 
(a) 
E(s) C(s) 
=| G(s) =| G(s) = 
T 
(b) 
E(s) A(s) A*(s) C(s) 
= G(s) =) G(s) > 
T 
(c) 
G(s) 


E(s) | — e75 C(s) 
T s 
(d) 


FIGURE 5-1 Open-loop sampled-data systems. 


For this case, no transfer function can be found since E(z) cannot be factored from G,E(z). In 
general, no transfer function can be written for the system in which the input is applied to an ana- 
log element before being sampled. However, the output can always be expressed as a function 
of the input, and as will be shown later, this type of system presents no particular difficulties in 


either analysis or design. For the system of Fig. 5-1(d), the output is 
CZ) = D@)G@)E@) 


where 


—Ts 


1 = 
Gl) = j= 


oo|- 2e] 
We now derive the output function for the system of Fig. 5-2. First we write 
C(s) = G(s)E*(s) 
and 
E(s) = R(s) — H(s)C(s) 


Substituting (5-5) into (5-6), we obtain 


E(s) = R(s) — G(s)H(s)E*(s) 


(5-5) 


(5-6) 


(5-7) 


5.2 Preliminary Concepts 


and by taking the starred transform (see Section 4.3), we have 


E*(s) = R*(s) — GH*(s)E*(s) (5-8) 
Solving for E*(s), we obtain 
E*( ) = RG) (5 9 
9 14 GHG) i 
and from (5-5), 
C(s) = G ee (5-10 
9) = 69) > T -10) 


which yields an expression for the continuous output. The sampled output is, then, 


FORO _ SORO 


C*(s) = G*(s)E*(s) = 1 + GEG) C(z) = 1+ GH 


(5-11) 


Here let us make an observation about practical implementations of systems as illustrated in 
Fig. 5-2. Since E*(s) is a series of impulse functions, we must assume that G(s) receives the 
impulses through a zero-order hold. This will always be the case in what follows unless speci- 
fied otherwise. Anytime a starred transform is applied to a Laplace transfer function, assume that 
the transfer function contains a zero-order hold to process its starred-transform input. 

Problems can be encountered in deriving the output function of a closed-loop system. This 
can be illustrated for the case above. Suppose that (5-6) had been starred and substituted into 
(5-5). Then 


C(s) = G(s)R*(s) — G(s)HC*(s) (5-12) 

and C*(s) is 
C*(s) = G*(s)R*(s) — G*(s)HC*(s) (5-13) 
In general, C*(s) cannot be factored from HC*(s). Thus (5-13) cannot be solved for C*(s). In 
general, in analyzing a system, an equation should not be starred if a system signal is lost as a 
factor, as shown above. However, for systems more complex than the one above, solving the 


system equations can become quite complex. A simpler method of analysis will now be devel- 
oped that avoids this problem. 


R(s) E(s) E*(s) 


—>_ Gs) 


C(s) 


FIGURE 5-2 Closed-loop sampled-data system. 
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R(s) E(s) 


+ 
Hs 
mwh 


First, however, consider the system of Fig. 5-3. Since the input is not sampled before being 
applied to an analog element, no transfer function can be derived. 
Nevertheless, the system can be analyzed. From Fig. 5-3 we note that 


FIGURE 5-3 Sampled-data system. 


C(s) = G(s)E(s) (5-14) 
and 
E(s) = R(s) — H(s)C*(s) (5-15) 
Substituting (5-15) into (5-14), we obtain 
C(s) = G(s)R(s) — G(s)H(s)C*(s) (5-16) 
Starring (5-16) yields 
C*(s) = GR*(s) — GH*(s)C*(s) (5-17) 


In this system, the forcing function R(s) is necessarily lost as a factor in (5-17), since r(t) is not 
sampled. Solving (5-17) for C*(s), we obtain 


ee GR*(s) = GR(z) : 
C*(s) TA Ga GHG) C(z) 14+ GHD GHO (5-18) 
The continuous output is obtained from (5-16) and (5-18) as 
_ G(s)H(s)GR*(s) 
C(s) = G(s)R(s) 1 + GH) (5-19) 


For the system of Fig. 5-3, no transfer function can be derived; the problem is that 
the input is not sampled before being applied to an analog part of the system. In a practical 
system, we generally have more than one input. Consider, as an example, an aircraft flying 
in a closed-loop mode (i.e., flying on autopilot). Suppose also that the autopilot is imple- 
mented digitally. Thus this system is a closed-loop digital control system. The commands into 
this system (e.g., an altitude change) may be inputted into the control computer through an 
analog-to-digital converter, or may even be generated by the computer itself. Thus this input 
is sampled, and a transfer function may be developed. However, the vertical component of 


5.3 Derivation Procedure 


R(s) 


FIGURE 5-4 Sampled-data control system. 


FIGURE 5-5 Original flow graph for the sampled-data system in Fig. 5-4. 


the wind, which must also be considered as an input into the altitude control system, is not 
sampled. Hence a transfer function can be derived from the command input to the output (the 
altitude); however, a transfer function cannot be developed from wind input to aircraft altitude 
as the output. 


5.3 DERIVATION PROCEDURE 


The determination of transfer functions for sampled-data systems is difficult because a transfer 
function for the ideal sampler does not exist. A procedure for finding transfer functions will now 
be developed using the system of Fig. 5-4, which has the flow graph shown in Fig. 5-5. We omit 
the sampler from the system signal flow graph, since a transfer function cannot be written for the 
device. Note that the effect of the sampler is included in the flow graph, since the sampler output 
is shown in starred form, Ej, and Ej will be treated as an input. This flow graph is referred to as 
the original signal flow graph. The sampled output C*(s) can be found for a discrete-time system 
of this type by employing the following step-by-step procedure. 


1. Construct the original signal flow graph. This has been done for the system and is shown 
in Fig. 5-5. 

2. Assign a variable to each sampler input. Then the sampler output is this variable starred. 
For this example, system Æ; is the input to the sampler and EŤ is the sampler output. 

3. Considering each sampler output to be a source node (input), express the sampler inputs 
and the system output in terms of each sampler output (which is treated as an input in the 
flow graph), and the system input. For this example, 


E, = R — GHEY (5-20) 
C = GE¥ (5-21) 


where FE, = E;(s), and so on. For convenience, the dependency on s will not be shown. 
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4. Take the starred transform of these equations and solve by any convenient method. For the 


example, 
E* = R* — GH*E* (5-22) 
C* = G*EF (5-23) 
From (5-22), 
R* 
* = — 5-24 
! 1+ GH* vee 
and, from (5-23) and (5-24), 
G*(s) 
=) SH BO (5-25) 


If there is more than one sampler in the system, the equations for the starred variables may be 
solved using Cramer’s rule, or any other technique that is applicable to the solution of linear 
simultaneous equations. 

The systems equations can also be solved by constructing a signal flow graph from these 
equations and applying Mason’s gain formula. This flow graph is called the sampled signal flow 
graph. This method is sometimes superior to Cramer’s rule, provided that the sampled signal 
flow graph is simple enough so that all loops are easily identified. To illustrate this approach, 
consider again equations (5-21), (5-22), and (5-23). The signal flow graph for these equations is 
shown in Fig. 5-6. From the flow graph, 


G*(s) 


CO) = Ty Gre 


R*(s) (5-26) 


and this result agrees with (5-25). Note also from Fig. 5-6 that 


G(s) 


CO) = TF GES) 


R*(s) (5-27) 


This method for finding the output function for closed-loop systems will now be illustrated via 
the following examples. 


C 
-GH* G 
* ok 
R 1 G 
O > > O 
Ei g“ 


FIGURE 5-6 Sampled signal flow graph for the system in Fig. 5-4. 


5.3 Derivation Procedure 


EXAMPLE 5.1 


Consider the digital control system of Fig. 5-7(a) which has the model given in Fig. 5-7(b) (see 
Section 4.4). The original flow graph is shown in Fig. 5-8. 
We can write 


E = R — GHD*E* 


C = GD*E* 
Hence 
—_ R* 
E* = R* — GH*D*E* — E* = —— 
1 + D*GH* 
C* = G*D*E* 
Thus 
D(z)G(z) 
C(z) = ——— R(z) 
1 + D(2)GH(z) 
Plant 
R(s) Diei C(s) 
gital > A p 
+ AD controller DIA G,fs) 
Sensor 
H(s) - 
(a) 
G(s) 
a ~ 
R(s) E(s) M*(s) i-e” C(s) 
a T = D(z) > F >| G,(s) as 
H(s) |4 
(b) 
FIGURE 5-7 Closed-loop digital control system. 
R 1 E E* D* M* G C 
Oo ce O i 
=H 


FIGURE 5-8 Original flow graph for Example 5.1. 
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Consider the system shown in Fig. 5-9. The original signal flow graph is shown in Fig. 5-10. 
The system equations are 


E; = R — GEt 
E, = G,E* = G HEŽ 
C = GEŽ 


Starring these equations, we obtain 


E¥ = R* — GE% 
EX = G*E* — G,H*Eš 
C* = GEX 


The sampled flow graph can then be drawn from these equations as shown in Fig. 5-11. 
Then applying Mason’s gain formula, we obtain 


G*G} G,(z)Go(z)R 
Ce = i k 2 Re a oe 1(Z)Go(Z)R(Z) 
1 + G{Gy + G»H* 1 + G,(z)Gp(z) + GoH(z) 
and 
Gy(s)G;° 

C(s) = cA Se 
1 + Gf(s)G3(s) + G,H*(s) 
= G(s) =| G(s) as 

= T _ T 


FIGURE 5-9 Sampled-data system for Example 5.2. 


FIGURE 5-10 Original flow graph for Example 5.2. 
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FIGURE 5-11 Sampled flow graph for Example 5.2. 


EXAMPLE 5.3 


As another example, consider the system shown in Fig. 5-12. Note that no transfer function may 
be derived for this system, since the input R(s) reaches G(s) without being sampled. The origi- 
nal signal flow graph is given in Fig. 5-13. From this Fig. note that 
E { R-C 
C=E, + G[G,Ef — C] 


Therefore, 
[l+1+G]C=R+ G,GEF 
and 
R GG 
C= 4+ —1 pt 
2+ G, 2+G, 
1+ G,)R G,G 
E =R C= ( 2) 192 $ 
2 +G 2 +G 
R(s) 4 E\(s) Ex(s) 
=] G(s) 
= T 


FIGURE 5-12 Sampled-data system for Example 5.3. 
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Or the equation for E, and C can be written directly from Fig. 5-13 using Mason’s formula. 


Hence 
R |* GiG |* 
2+ G 2+ G 


a i“ + T | GiG E 
2+6G 2+G| 7 


i= 


The sampled flow graph derived from these equations is given in Fig. 5-14. Then by employing 
Mason’s gain formula, we obtain 


* * 
| (s) + [£ F coh) (s) 


x = | — 
oe) Ean 2+ G 


Note that, as stated above, no transfer function is possible, since the input is fed into a continuous 
element in the system, G»(s), without first being sampled. 


FIGURE 5-13 Original flow graph for Example 5.3. 


(GiG) ]* 
2+G, 
(1+G,)R |” 
2+G, 
O = 
1 E”, 


FIGURE 5-14 Sampled flow graph for Example 5.3. 


As mentioned above, matrix methods, or Cramer’s rule, may be simpler to use in solving 
the system equations, if there are many loops in the sampled signal flow graph. This is especially 
true when all the loops of the flow graph are not easily identified. However, once one has gained 
experience and proficiency in the use of signal flow graphs, these flow graphs can be easily used 
to obtain quick and accurate solutions for less complex systems. 
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EXAMPLE 5.4 


As a final example, consider the system of Fig. 5-15, which contains a digital controller with a 
computation time of f seconds, fj) < T. The effect of the computation time is modeled as the 
ideal time delay (see Section 4.6). 

The original signal flow graph is given in Fig. 5-16. The system equation is then, from 
Mason’s gain formula, 


GR GH, “°° 
c= D*C* 
1+ GH, 1+GH, 
and thus 
ce) = | ) | \D(Z)C(Z) 
li +oH, |” (1+ Gn, Je" 
where mT = T — t. The second equation may be solved directly for C(z) . 
GR 
ae F + a (© 
j 1+ Een )D(Z) 
1+ GHO AY 
R(s) g 
K G(s) ° = 
jk C(s) 
H, (s) j4 $ 


D(z) j4 


Hs) j— © je 


FIGURE 5-15 System for Example 5.4. 


gos 


FIGURE 5-16 Original flow graph for Example 5.4. 
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If the computational delay is greater than one sampling interval (i.e., if tọ = kT + AT, k isa 
positive integer), the denominator becomes 


1+2z* [le m)D(z) 
1+ GH |” 


where mT = T — AT. 


5.4 STATE-VARIABLE MODELS 


A technique for finding the transfer function of a closed-loop discrete-time system was presented 
above. As shown in Chapter 4, a discrete-time state-variable model may be generated directly 
from the transfer function. However, this technique has the disadvantage that the analog system 
physical variables generally do not appear as discrete-time state variables. 


CONVERTING CONTINUOUS STATE EQUATIONS. The technique of converting continuous 
state equations to discrete-time state equations, presented in Section 4.10, may also be utilized 
in determining a discrete-time state-variable model for a closed-loop system. The application of 
this technique will be illustrated by an example. Consider the system of Example 5.2, which is 
repeated in Fig. 5-17(a). As a first step, the system is redrawn such that zero-order-hold outputs 


R(s) + E\(s) EXS) + Ex(8) Ex(s) 
—— — G 1 (s) ———] G,(s) — 
_ T Y(s) 


(a) 


Analog part of system 


PSS SSS SS Se SSeS See ee Sees 


E\(s) | + 
Grols) i G, 108) 
1 
= 


E}(s) 


AA 


Rs) + E\(s) E,(s) 
Or 


Y(s) 


(b) 


FIGURE 5-17 Closed-loop system. 


5.4 State-Variable Models 


are shown as inputs, and sampler inputs and the system output are shown as outputs. The results 
of this step are shown in Fig. 5-17(b). Hence we are considering the analog part of the system 
as in Fig. 5-18(a) [E;(s) is not shown as an output, since it is determined directly from the sys- 
tem output Y(s)]. Next the continuous state equations for this part of the system are written, 
and from these equations, the discrete-time state equations are generated. For this system, the 
discrete-time state equations will be of the form 


= elk) 
v(k + 1) = Ayv(k) + Bo | 
wk) a 
o] EA Dep | oe) 


Either a discrete simulation diagram or a flow graph is then constructed from these state equa- 
tions, and should include all connecting paths of the closed-loop system external to the simula- 
tion diagram for (5-28). The result for the system considered is shown in Fig. 5-18(b). From this 
simulation diagram the system discrete state equations may be written. An example to illustrate 
this technique will now be given. 


Plant 
E\(s) + E,(s) 
: | G(s) ~) 2 
Plant 
E,(s) 
: Gya(s) H(s) 
Y(s) 
Ea 
(a) 
-1 
rk) 1 
e > = i y(k) 
Discrete model 
e(k) for analog part 
of system, 
Equation 
ex(k) 5-38) 
ex(k) 


(b) 
FIGURE 5-18 Technique for determining the discrete-time state model. 
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The discrete state model for the system of Fig. 5-17 will be derived, with T = 0.1 s, and with 


l-e”? 1-¢% 


G(s) = sX(s + 1) s Gp1(8) 
2 1 -. arts 1 _— oe Ts 
Cs) 7 > B = Gals) 
CRUE Saeed’ “RU a OS oa ag 


A flow graph of the system of Fig. 5.18(a) is shown in Fig. 5-19(a). From this flow graph we 
write the continuous state equations: 


0 1 0 o0 0 0 
A 0 -1 0 0 1 0 7 
t) = t) + 
WES o 40°" aon T oo ee 
0 O 0 -2 0 2 


Pelee 0 0 1 
e| lı 0 -1 0 


In these equations, e; (t) is the zero-order-hold output with e(t as its input, and é,(f) is defined in 
the same manner. To obtain the discrete state matrices, we use the technique of Section 4.10 and, 
for this example, calculate the following matrices by computer: 


þw 


1 0.0952 0 0 0.00484 0 
: 0952 k 
ea 0 0.905 0 0 Wisk 0.095 0 b l 
0 o0 0.368 0.563 0 0.0686 || e2(k) 
0 0 0 0.819 0 0.181 


kolli o = 


{1 0 SI 


1 
e(k) 0 |X 


A simulation diagram of this system, with all external connecting paths, is shown in Fig. 5-19(b). 
From this simulation diagram we write the discrete state equation for the closed-loop system. 


1 0.0952 0 —0.00484 0.00484 
0 0.905 0 —0.0952 0.0952 

WEED | gege: 0 0299 0563 VOTI 9 n 
0.181 0 0.181 0.819 0 


yk) = [0 0 0  I]v(k) 


5.4 State-Variable Models 


r(k) 


(b) 


FIGURE 5-19 System for Example 5.5. 


Note the similarity of this technique to that developed earlier for finding closed-loop 
transfer functions. The system is opened at each sampler, each zero order-hold output is 
assumed to be an input, and each sampler input is assumed to be an output. Discrete state 
equations are then written relating these specified inputs and outputs. These state equations 
are manipulated, through the use of a simulation diagram, to obtain the state equations of the 
closed-loop system. 

The technique above can be applied to low-order systems; however, writing system 
equations from complex flow graphs is at best tenuous. Instead, a matrix procedure that can 
be implemented by a computer program is needed, and one will now be developed. Consider 
Example 5.5. The discrete state equations for the continuous system can be written as 
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v(k + 1) = A,v(k) + Bye(k) (5-29) 
e(k) = C,v(k) + Dir(k) (5-30) 
where e(k) = [e,(k) ex(k)]’. Thus these equations can be combined to yield 
v(k + 1) = [A, + B,C, ]v(4) + B,Dyr(k) (5-31) 
which is the required equation. An example will now be given. 
EXAMPLE 5.6 
Consider the system of Example 5.5. Since e,(k) = r(k) — y(k) = rk) — va(k) and 
€o(k) = v,(k) — v3(k), the equations for e(k) can be written as 
| h 0 0 =| A 
= k) + k) = Cyv(k) + Dyr(k 
p jie, Sa 0 v(k) 0 r(k) 1v(k) ir(k) 
Then, in (5-31), 
0.00484 0 
0.0952 0 0 0 0 -l1 
B,C, = | | 
0 0.0686 |L1 0 -l1 0 
0 0.181 
0 0 0 —0.00484 
_ {0 0 0 —0.0952 
0.0686 0 —0.0686 0 
0.181 0 —0.181 0 
and 
1 0.0952 0 0 0 0 0 —0.00484 
: —0.0952 
A, + B,C, = 0 0.905 0 0 i: 0 0 0 0.095 
0 0 0.368 0.563 0.0686 0 —0.0686 
0 0 0 0.819 0.181 0 —0.181 
1 0.0952 0 —0.00484 
_ | 0 0.905 0 —0.0952 
0.0686 0 0.2994 0.563 


0.181 0 —0.181 0.819 


5.4 State-Variable Models 


Also, in (5-31), 


0.00484 0 0.00484 
0952 1 0952 
BD, = 0.095 0 | |= 0.095 
0 0.0686 0 0 
0 0.181 0 


These results agree with those obtained in Example 5.5 and are less prone to error. Also, the 
matrix procedure of this example can be implemented on a digital computer. 


As a final point, note that each system input must be sampled prior to being applied to 
an analog part of the system. If this is not the case, (5-30) cannot be written as a function of 
only r(k), and no discrete model is possible. If an input that is not sampled varies slowly over a 
sample period (only low frequencies appear in the input signal), this input is often assumed to be 
sampled, even though the resultant discrete model is somewhat in error. 


INCLUDING A DIGITAL CONTROLLER. System state equations are more difficult to derive 
if the system contains a digital controller. A single-loop digital control system is shown in 
Fig. 5-20(a). To obtain the state equations, we consider the digital filter and the plant separately 
and write the state equations for these two parts. We assign states v,(k) through v;(k) to the plant, 
where i is the order of the plant. Then we assign states v,,,(k) through v,(k) to the filter, where 
n — iis the order of the filter. Hence we can write the state equations 


v(k + 1) = A,wk) + Bym(k) + Belk) (5-32) 


u(k) e(k) m(k) y(k) 
Ea Filter — Plant 


(a) 


Plant 
m(k) States y(k) 
— vy(k) - e 
v,(k) 
Filter 
e(k) States mk) 
— vk) - m 
v,(k) 
(b) 


FIGURE 5-20 Discrete control system. 
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since both m(k) and e(k) are inputs, as shown in Fig. 5-20(b). Next we write for the filter 
m(k) = C,v(k) + Dye(k) (5-33) 
and for the plant 
y(k) = Cv(k) (5-34) 


Thus, for the feedback path and from (5-34), we write 


elk) = ulk) — y(k) = ulk) — Cv(k) (5-35) 


We obtain the system state equations by eliminating m(k) and e(k) from (5-32), (5-33), and 
(5-35). From (5-33) and (5-35), 


mk) = Cyv(k) + Dilu — Cv(k)] = [C — D,C]v(k) + Dulk) (5-36) 
Then, substituting (5-35) and (5-36) into (5-32), we obtain 
v(k + 1) = Ayw(k) + B,[(C; — Di C)w(k) + Dulk] 
+ B,[u(k) — Cv(k)] (5-37) 
= [A; + B,C; + (~B: — B,D,)C}v(k) + (B,D; + ByJuck) 
In our standard notation, 


vk + 1) = Av(k) + Bu(k) 
A= Ay T B,C, gg (—B, = B,D,)C (5-38) 
B = BD + B, 


An example will now be given. 


EXAMPLE 5.7 


The state equations for the system of Example 4.13 (shown in Fig. 5-21 (a)) will be developed. 
From Example 4.13, the state equations for the plant are 


Ee + | i f aed 2 a ® 
vo(k + 1) 0 0.905 |Lvo(k) 0.952 |” 
r 

h=[1 0 
yk) = [ ike 


The filter is modeled as shown in Fig. 5-21(b). The state equations for the filter are 
v3(k + 1) = 0.9v3(k) + e(k) 


m(k) = (0.81 — 0.8)v3(k) + 0.9e(k) 
= 0.01vx(k) + 0.9e(k) 


5.4 State-Variable Models 


Filter Data hold Plant 
u(t) + e(t) 0.92 — 0.8 l-e® | mo) 10 ye) 
à T=0.1s z—0.9 sS S(s 
(a) 
0.9 
elk) 1 z! vik) 
Oo = o m(k) 
0.9 


FIGURE 5-21 System for Example 5.7. 


Combining the state equations for v(k), we obtain 


vi(k + 1) 1 0.0952 0 [vb 0.0484 0 
vk +1)}=]0 0.905 0 |] vk) | +] 0.952 |m(k) + | 0 le% 
v3(k + 1) 0 0 0.9 |L v3(k) 0 1 


Also, from Fig. 5-21, since e(t) = u(t) — y(®, 
e(k) = u(k) — y(k) = uk) — [1 0 O]v(k) 


and from above, 
m(k) = [0 0 0.01]v(k) + 0.9e(k) 


Comparing the equation above for v(k) with (5-32), we see that 


1 0.0952 0 0.0484 0 
A =|0 0.905 0 |, B, =|]0.952 |, B, =|0 
0 0 0.9 0 1 


From the equation above for m(k) and (5-33), 
C,=[0 0 001], D; = 0.9 
and from the equation above for e(k) and (5-35), 
C=[1 0 0] 
Then, in (5-37), 


0.0484 0 0 0.000484 
B,C; = | 0.952 |[(0 0 0.01] =}]0 0 0.00952 
0 0 0 0 
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0 — 0.9(0.0484) 


(B — BDDC =| 0 — 0.900.952) | 0 0 
—1 — 0.9(0) 
—0.04356 0 0 
= | —0.8568 0 0 
-1 0 0 


Thus 


0.9564 0.0952 0.000484 


A, + B,C, + (B — B,D)C = | —0.8568 0.905 0.00952 
=l 0 0.9 
0.04356 + 0 
0 +1 


Thus the state equations for this system are, from (5-37) and (5-34), 


0.9564 0.0952 0.000484 0.04356 
wk + 1) = | —0.8568 0.905 0.00952 |v(k) + | 0.8568 |u(k) 
=] 0 0.9 1 


yk) = [1 0 Ol% 


The calculations above are implemented in the following MATLAB program: 


>> 
Al 
Bl 


% Use (5-38) to close the loop 

[1 0.0952 0;0 0.905 0;0 0 0.9]; 
[0.0484;0.952;0]; B2=[0;0;1]; 

C1=[0 0 0.01]; C=[1 0 0]; D1l=0.9; T=0.1; 

A=A1+B1*C1+(-B2-D1*B1)*C % Closed-loop A matrix 

B=D1*B1+B2 % Closed-loop B matrix 

C=C % Closed-loop C matrix 

D=0 % Closed-loop D matrix 


A = 
0.9564 0.0952 0.0005 
-0.8568 0.9050 0.0095 
-1.0000 0 0.9000 
B = 
0.0436 
0.8568 
1.0000 
C = 
1 o o0 
D = 
0 


Next we will find the closed-loop transfer function 7(z) and verify it by transfer function analysis. 
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>> % Continuing the program, find T(z) using the closed-loop 
state matrices A, B, C, and D 
T=0.1; [num,den]=ss2tf(A,B,C,D,1); 
Tz=t£ (num, den, T) 
% Check the result by computing T(z) using G(z) and D(z) 
Gp=t£([10],[1 1 0]); 
Gz=c2d(Gp,T); 
Dz=tf£([0.9 -0.8],[1 -0.9],T); 
Tz_check=feedback (Dz*Gz,1) 


Tz = 
0.04356 z*2 + 0.003426 z - 0.03746 


Z*3 - 2.761 z*2 + 2.623 z - 0.852 


Tz_ check = 
0.04354 z*2 + 0.00341 z - 0.03743 


z^3 - 2.761 zî2 + 2.623 z - 0.8518 


Examples 5.6 and 5.7 illustrate the derivation of discrete state models for digital control systems. 
Of course, some systems are more complex than these in the examples above. However, the 
technique used to derive the state equations of (5-38) may be employed for more complex sys- 
tems. For example, if y(k) in (5-34) is also a function of m(k), the derivation is somewhat more 
complicated (see Problem 5.4-11). 


5.5 SUMMARY 


In this chapter, we have described a technique for finding the Laplace and z-transforms of the 
output of a closed-loop discrete-time system. The technique assumes the availability of a block 
diagram or signal flow graph of the discrete-time system. From this specification, a sampled 
signal flow graph is derived which can be used to determine the Laplace transform and the 
z-transform of the output of the closed-loop system. In addition, a technique is developed for 
determining the state-variable model of a closed-loop discrete-time system provided all inputs 
are sampled. In the following chapters these techniques will be utilized in analyzing and design- 
ing closed-loop discrete-time systems. 
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Problems 


5.3-1. 


5.3-2. 


5.3-3. 


5.3-4. 


5.3-5. 


5.3-6. 


5.3-7. 


5.3-8. 


5.3-9. 


5.3-10. 


5.3-11. 


For each of the systems of Fig. P5.3-1, express C(z) as a function of the input and the transfer functions 
shown. 


For each of the systems of Fig. P5.3-2, express C(z) as a function of the input and the transfer functions 
shown. 


(a) Derive the transfer function C(z)/R(z) for the system of Fig. P5.3-1(b). 

(b) Derive the transfer function C(z)/R(z) for the system of Fig. P5.3-1(c). 

(c) Even though the two systems are different, the transfer functions are equal. Explain why this is true. 
Hint: Consider the error signal. 


Consider the system of Fig. P5.3-4. 

(a) Calculate the system output C(z) for the signal from G,(s) disconnected from the middle summing 
junction. 

(b) Calculate the system output C(z) for the signal from G(s) disconnected from the last summing junction. 

(c) Calculate the system output C(z) for the system as shown. 


For the system of Fig. P5.3-1(a), suppose that the sampler in the forward path samples at t = 0,7, 2T, ... , 
and the sampler in the feedback path samples at t = T/2, 3T/2,5T/2,.... 

(a) Find the system transfer function C(z)/ R(z). 

(b) Suppose that both samplers operate at t = T/2, 37/2, 57/2, . . . . Find C(z) in its simplest form. 


The system of Fig. P5.3-6 contains a digital filter with the transfer function D(z). 
Express 6,,(z) as a function of the input. The roll-axis control system of the Pershing missile is of this 
configuration [2]. 


Consider the two-loop system of Fig. P5.3-7. The gain K is used to give the inner loop certain specified 
characteristics. Then the controller D(z) is designed to compensate the entire system. The input R(z) is 
generated within the computer, and thus does not exist as a continuous signal. Solve for C(z). 


The system of Fig. P5.3-8 is the same as that of Example 5.1, except that the sampler has been moved to the 

feedback path. This may occur for two reasons: (1) the sensor output is in sampled form and (2) the input 

function is more conveniently generated in the computer. 

(a) Calculate both C(s) and C(z) for the system of Fig. P5.3-8. Note that C(s) cannot contain the variable z. 

(b) Note that the output functions in part (a) are identical to those found in Example 5.1, even though the two 
configurations are different. Explain why. 


For Fig. P5.3-1, list, for each system, all transfer functions that contain the transfer function of a zero-order hold. 


For Fig. P5.3-2, list, for each system, all transfer functions that contain the transfer function of a zero-order 
hold. 


In the system of Fig. P5.3-11, the ideal time delay represents the time required to complete the computa- 

tions in the computer. 

(a) Derive the output function C(z) for this system. 

(b) Suppose that the ideal delay is associated with the sensor rather than the computer, and the positions of 
Hs) and the ideal delay are reversed. Find C(z) for this case. 


R(s) + C(s) 
— >| G(s) 
H(s) — A 
(a) 
R(s) + C(s) 
=| G(s) 
IK = 
— Hs) 
(b) 
R(s) + C(s) 
=| G(s) > 
H(s) 
(c) 
R(s) C(s) 
G(s) > 
A(s) P 
R(s) C(s) 
G(s) > 


H(s) 


FIGURE P5.3-1 Systems for Problem 5.3-1. 


(e) 
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R + 
| G(s) ai G(s) eal 
= if T C 
H(s) * 
(a) 
R(s) + C(s) 
=) G(s) >| G(s) > 
= T 
H(s) + 
T 
(b) 
R + + 
G(s) >| G(s) > 
C 
Ha(s) * 
T 
Hs) |= 
(c) 
R + 
>| G(s) = 
= = C 
H (s) * D(z) * 
T 
Hs) }* 
(d) 
R(s) 


G(s) 


>| A/D = D(z) >) D/A = 


G(s) 


FIGURE P5.3-2 Systems for Problem 5.3-2. 


C(s) 


Problems 
G,(s) 
+ 
R) + + + Cs) 
=| G(s) a 
H(s) 
FIGURE P5.3-4 Systems for Problem 5.3-4. 
Data hold and 
Demodulator Controller vane hydraulics Aerodynamics 
o,(s) + 
=| G4(s) >| D(z) >| G(s) =| G(s) s 
T Pms) 
FIGURE P5.3-6 Roll-axis control system for a Pershing missile. 
PEENE EPE EE ANE E PE E A eece ` 
Computer i 
I 
1 
i Cs) 
G(s) Gps) => 


FIGURE P5.3-7 System for Problem 5.3-7. 


FIGURE P5.3-8 System for Problem 5.3-8. 


Computer 


C(s) 


DIA = G,(s) 


AID |}*—— Hs) 
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R(s) + C(s) 


—0.1Ts jæ D(z) eae 


H(s) 


À 
M 


FIGURE P5.3-11 System for Problem 5.3-11. 


5.3-12. Shown in Fig. P5.3-12 is the block diagram for the temperature control system for a large test chamber. 


This system is described in Problem 1.6-1. The disturbance shown is the model of the effects of opening the 
chamber door. The following transfer functions are defined. 


21 — @ 7) GAs) 2.5 
s(s + 0.5)’ aS) = FOS 


G(s) = H, = 0.04 


(a) Derive the transfer function C(z)/R(z), in terms of the transfer functions just defined. 

(b) With r(t) = 0, solve for the output function C(s) in terms of the disturbance input and the transfer 
functions just defined. 

(c) Use superposition and the results of parts (a) and (b) to write the complete expression of C(z). 


Disturbance 
RAs) 


Controller 


— D(z) - 


FIGURE P5.3-12 Chamber temperature control system. 


5.3-13. Consider the robot-joint control system of Fig. P5.3-13. This system is described in Problem 1.5-4. 


(a) The sensor input is 8, in degrees and the output is in volts. If the robot joint movement is mechanically 
restricted to +135°, find the range of the sensor output voltage. What should be the input voltage range 
for the A/D? 

(b) Let G,(s) be the transfer function of the servomotor and gears, and H, = 0.05 be the sensor gain. 
Find the system transfer function as a function of K, G,(s), and so on. 

(c) Evaluate the system transfer function for K = 1.4, T = 0.3 s, and D(z) = 1.1. 
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Power 
Controller amplifier Servomotor Gears 
9. + Zero-order Ea 200 Om 1 9, 
>| D(z) |__| — | K | | = 
T hold N if s (0.5s+1) 100 
Volts 
Sensor 
Volts 
0.05 


FIGURE P5.3-13 Robot arm joint control system. 


5.3-14. Consider the satellite control system of Fig. P5.3-14. The unit of the attitude angle (4) is degrees, and the 
range is 0 to 360°. The sensor gain is H, = 0.05. 


(a) 
(b) 


(c) 
(d) 


Suppose that the input ranges for available A/Ds are 0 to 10 V, 0 to 20 V, 0 to 30 V, +10 V, +20 V, 
and +30 V. Which range should be chosen? Why? 

The input signal r(f) is a voltage. Find the required value of r(t) to command the satellite attitude angle 
O(t) to be 80°. 

Repeat parts (a) and (b) if the range of 6(f) is + 180°. 

Let G,(s) = 1/ (Js*), the satellite transfer function. Find the system transfer function as a function of 
the transfer functions D(z), K, and so on. 


(e) Evaluate the system transfer function for D(z) = 1, T = 0.5 s, K = 4, and J = 0.2. 
Digital Amplifier and 
Controller thrusters Satellite 
R(s) + Ms) T(s) 1 O(s) 
>| A/D D(z) m| DA m K == 5 > 
r(t) Torque Js“ (C9) 
Sensor 
H, = 


FIGURE P5.3-14 Block diagram for a satellite control system. 


5.3-15. Consider the antenna control system of Fig. P5.3-15. The unit of the antenna angle @(f) is degrees, and the 
range is + 135°. 


(a) 
(b) 


(c) 
(d) 


The input signal r(k) is generated in the computer. Find the required values of r(k) to command the 
satellite attitude angle 0(f) to be + 60°. 

Let G,(s) = 10/ (s? + 4s), the transfer function of the motor, gears, and pedestal. Find the system 
transfer function as a function of the transfer functions D(z), K, and so on. 

Evaluate the system transfer function for D(z) = 1, T = 0.05 s, and K = 20. 

Verify the results in part (c) using MATLAB. 
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! Computer i Motor, 
l Digital | gears, and 
i controller | Amplifier pedestal 
I 
RO + M(s) 10 @(s) 
i >| D(z) ~>] DIA >| K 5 
1 r(k) so +4s 0(t) 
i i 
I I 
| PEE EE tad ay lt eer ed seen om E e =| 
a Sensor 
i i 
1 
Vi) 
= 0.5 je ' 
ji j) 
| 1 


Binary data 


FIGURE P5.3-15 Block diagram for an antenna control system. 


5.4-1. 


5.4-2. 


5.4-3. 


5.4-4. 


Given a closed-loop system described by the transfer function 


Cz) _ z2 + 0.6z + 0.4 
R@) 2 —22+18 


(a) Express c(k) as a function of r(k), as a single difference equation. 

(b) Find a set of state equations for this system. 

(c) Calculate the transfer function from the results of part (b), to verify these results. 
(d) Verify the results in part (c) using MATLAB. 


Repeat Problem 5.4-1 for each of the transfer functions 


C 0.5 C 0.4 
(a) co) = Z (b) co) = 
R(z) z— 18 R(z) z — 0.16 
C(z) 0.1z — 0.05 C(z) 0.27z + 0.5 
(c) R = (d) =a 
(z) z— 0.9 Rz) — 1.62 + 0.8 


For the system of Fig. P5.3-1(a), let T = 0.5 s and 


sigs = gT 


l-e 1 
G(s) = 2° H(s) = 


sts 


(a) Calculate G(z) and A(z). 

(b) Draw simulation diagrams for G(z) and H(z), and interconnect these diagrams to form the control sys- 
tem of Fig. P5.3-1(a). 

(c) Write the discrete state equations for part (b). 

(d) Find the system characteristic equation, using the transfer functions of part (a). 

(e) Show that the state model in part (c) has the same characteristic equation as in part (d). 


Let T = 0.5 s for the system of Fig. P5.4-4. Derive a set of discrete state equations for the closed-loop 
system, for the plant described by each of the differential equations. 


d 
(a) a + Sy(t) = 3TA 


Choose the state variable to be y(kT). 
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Plant 
-rs | M) Ys) 


> lve +) Go) 


Us) + Ms) 


FIGURE P5.4-4 System for Problem 5.4-4. 


5.4-5. 


5.4-6. 


5.4-7. 


PYA „ 90 


b 
(o) dt’ dt 


+ 8y(t) = 4m(t) 


Choose the state variables to be y(kT) and dy(t)/dt| ;=xr- 


Suppose that the plant in Fig. P5.4-4 has the discrete state model 


x(k + 1) = Ax(k) + Bm(k) 
y(k) = Cx(k) + Dm(k) 


Derive the state model for the closed-loop system, in terms of A, B, C, and D. 


Find a discrete state variable model of the closed-loop system shown in Fig. P5.4-4 if the discrete state 
model of the plant is given by: 
(a) x(k + 1) = 0.7x(k) + 0.3m(k) 

yk) = 0.2x(k) + 0.5m(k) 


0 1 0.1 
(b) x(k + 1) = ie bo + aco 


y(k) = [1.2 —0.7]x(k) 


05 0 O 1 
(c) xk+t1 =|] 0 09 1 Ix(k) +] 0 lm 
-1 0 09 2 


y(k) = [1 0 O}x(k) 


Consider the temperature control system of Problem 5.3-12 and Fig. P5.3-12. Suppose that the digital filter 
transfer function is given by 


0.02z 


D(z) = 1.1 + 


which is a PI (proportional-integral) controller. Suppose that T = 0.6 s, and let Rs) = 0 (ignore the 

disturbance input). 

(a) Using the closed-loop transfer function, derive a discrete state model for the system. 

(b) Derive a discrete state model for the plant from the plant transfer function. Then derive the state model 
of the closed-loop system by adding the filter and the feedback path to the flow graph of the plant. 

(c) Calculate the transfer function from the state model of part (b), to verify these results. 

(d) How are the states of parts (a) and (b) related? Do not solve for the exact relationship. 
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5.4-9. 


5.4-10. 


5.4-11. 


5.4-12. 


5.4-13. 
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Consider the satellite control system of Problem 5.3-14 and Fig. P5.3-14. Let D(z) = 2, T = 2 s, K = 4, 

J = 0.2, and H, = 0.04. 

(a) Using the closed-loop transfer function, derive a discrete state model for the system. 

(b) Derive a discrete state model for the plant from the plant transfer function. Then derive a state model 
for the closed-loop system by adding the feedback path and system input to a flow graph of the plant. 

(c) Calculate the system transfer function from the state model found in part (b), to verify the state model. 

(d) Verify the results in part (c) using MATLAB. 


Consider the antenna control system of Problem 5.3-15 and Fig. P5.3-15. Let D(z) = 1, T = 0.05 s, and 

K = 20. 

(a) Using the closed-loop transfer function, derive a discrete state model for the system in the observer 
canonical form of Fig. 2-10. 

(b) Derive a discrete state model for the plant from the plant transfer function. Then derive a state model 
for the closed-loop system by adding the feedback path and system input to a flow graph of the plant. 

(c) Calculate the system transfer function from the state model found in part (b), to verify the state model. 

(d) Verify the results in part (c) using MATLAB. 


Consider the robot joint control system of Problem 5.3-13 and Fig. P5.3-13. Let D(z) = 1, T = 0.1 s, and 

K = 24. 

(a) Using the closed-loop transfer function, derive a discrete state model for the system. 

(b) Derive a discrete state model for the plant from the plant transfer function. Then derive a state model 
for the closed-loop system by adding the feedback path and system input to a flow graph of the plant. 

(c) Calculate the system transfer function from the state model found in part (b), to verify the state model. 


Suppose that, for the system of Fig. 5-20, equation (5-34) is 
wk) = Cv(k) + dym(k) 


(a) Derive the state model of (5-37) for this case. 

(b) This system has an algebraic loop. Identify this loop. 

(c) The gain of the algebraic loop is —d,d,. What is the effect on the system equations if did) = —1? 

(d) We can argue that algebraic loops as in this case cannot occur in physical systems, since time delay is 
always present in signal transmission. Quite often we can ignore this delay. Under what conditions can we 
obviously not ignore delay in this system? 


Consider the satellite control system of Problem 5.3-14 and Fig. P5.3-14. Let D(z) = (z — 1)/(z — 0.5), 

T = 138, K = 2,J = 0.1, and H, = 0.02. Use MATLAB to compute: 

(a) A discrete state model for the system using the closed-loop transfer function. 

(b) A discrete state model for the plant from the plant transfer function. Then compute a state model for the 
closed-loop system by adding D(z) and including the feedback path and system input. 

(c) Calculate the system transfer function from the state model found in part (b) and compare it with part 
(a) to verify the state model. 


Consider the antenna control system of Problem 5.3-15 and Fig. P5.3-15. Let D(z) = (4z — 3)/(z — 0.5), 

T = 0.05 s, and K = 20. 

(a) A discrete state model for the system using the closed-loop transfer function. 

(b) A discrete state model for the plant from the plant transfer function. Then compute a state model for the 
closed-loop system by adding D(z) and including the feedback path and system input. 

(c) Calculate the system transfer function from the state model found in part (b) and compare it with part 
(a) to verify the state model. 
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5.4-14. Consider the robot joint control system of Problem 5.3-13 and Fig. P5.3-13. Let D(z) = (24z — 21)/ 

(z — 0.5), T = 0.1s, and K = 2.4. 

(a) A discrete state model for the system using the closed-loop transfer function. 

(b) A discrete state model for the plant from the plant transfer function. Then compute a state 
model for the closed-loop system by adding D(z) and including the feedback path and system 
input. 

(c) Calculate the system transfer function from the state model found in part (b) and compare it 
with part (a) to verify the state model. 


System Time-Response 
Characteristics 


6.1 INTRODUCTION 


In this chapter we consider five important topics. First, the time response of a discrete-time 
system is investigated. Next, regions in the s-plane are mapped into regions in the z-plane. Then 
by using the correlation between regions in the two planes, the effect of the closed-loop z-plane 
poles on the system transient response is discussed. Next, the effects of the system transfer char- 
acteristics on the steady-state system error are considered. Finally, the simulations of analog and 
discrete-time systems are introduced. 


6.2 SYSTEM TIME RESPONSE 


In this section the time response of discrete-time systems is introduced via examples. In these 
examples some of the techniques of determining the system time response are illustrated. 


EXAMPLE 6.1 


The unit-step response will be found for the first-order system in Fig. 6-1(a). Since the plant of 
a temperature control system is often modeled as a first-order system, this system might then be 
the model of a temperature control system (see Section 1.6). Using the techniques developed in 
Chapter 5, we can express the system output as 


_ _ G&) 
oo 1 + G(z) ae 


where G(z) is defined as 


l-e” 4 z-1 4 
G(z) = 3 = 5 


6.2 System Time Response 


—z-1 2-8) 
zZ @=)G=<e") 


0.3625 _ 94 
z — 0.8187 


from the transform table in Appendix VI. Thus the closed-loop transfer function T(z) is given by 


G(z) 0.3625 
1+ Gz) z — 0.4562 
R(s) + E(s) | net (EO 4 C(s) 
T=0.1s Ss SFZ 
(a) 


c(t) 


= 


0.6 


Sampled-data system 


0.4 ‘Analog system 


0.2 


» 
0 0.2 0.4 0.6 0.8 t) 
(b) 
e(t) A 
1.0 
0.8 | 
0.6 = 
0.4 | 
0.2 = 
, l | | , | , | > 
0 0.2 0.4 0.6 0.8 t(s) 
(c) 


FIGURE 6-1 System and response for Example 6.1. 
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Since R(z) = 3[1/s] = z/(z — 1), 


0.3625z _ 0.667z cf —0.667z 
(z — Iz — 0.4562) z-1 z- 0.4562 


C(z) = 


The inverse z-transform of this function yields the system time response at the sampling instants. Thus 
c(kT) = 0.667[1 — (0.4562)*] 


This response is listed in Table 6-1. It is seen that the response reaches a steady-state value of 
0.667. The computations above may be done in MATLAB: 


>> T = 0.1; Gs = tf([4], [1 2]); Gz = c2d(Gs,T); 
Tz = feedback(Gz,1); Rz = tf([1 0],[1 -1],T); 
Cz = zpk(Rz*Tz) 

Cz = 

0.3625 z 


>> % Partial fraction expansion of C(z)/z 
[r,p,k] =residue([0.3625],[1 -1.4562 0.4562]) 

E = 

0.6666 

-0.6666 


EXAMPLE 6.2 


This example is a continuation of Example 6.1. To show some of the effects of sampling on the 

system response, we will remove the sampler and zero-order hold, and solve for the unit-step 

response of the resulting analog system. The closed loop transfer function T,(s) is given by 
G,(s) 4 


ON TE Gy FE 


where G,(s) = 4/(s + 2) is the plant transfer function. Hence the analog system unit-step 
response is given by 


4 0.667 | —0.667 
= + 


CM abe. a S E6 


and 
c,(t) = 0.667(1 — &%) 


This response is also listed in Table 6-1. Both step responses are plotted in Fig. 6-1(b). 


6.2 System Time Response 


TABLE 6-1 Responses for Example 6.1 


kT c (kT) ca À 

0 0 0 

0.1 0.363 0.300 

0.2 0.528 0.466 

0.3 0.603 0.557 

0.4 0.639 0.606 

0.5 0.654 0.634 

0.6 0.661 0.648 
0 666 0665 


We may also calculate the response at all instants of time for the sampled-data system. The 
continuous output of the system of Fig. 6-1(a) is given by 


C6) = G(s) Bs) = G ll a | G( | 2 | 
s) = G(s s) = G(s)) ———~ | = G(s)} ———- 
1 + G*(s) 1 + G(@) Je=er 
ae, 
_44-e%) z-1 _ 4 | 1 | 
s(s + 2) | 1 + G(2) page s(s + 2)L 1 + G(Z) J-=e" 
In this expression, 
1 - 1 _ z — 0.8187 
1 + Gz) 1 0.3625 z — 0.4562 
z — 0.8187 
= 1 — 0.3637! — 0.1657? — +> 
In C(s) above, let the first factor be denoted as C;(s), that is, 
oe 4 _ 2 2 
D: s(s + 2) sS s+2 
Then 
aO = 2(1 — e”) 
Thus the output C(s) is 
C(s) = C\(s)[1 — 0.363e% — 0.165¢ 77 — --- | 


and hence 
c(t) = 21 — £” — 0.363(2)(1 — ° Mult — T) 
—0.165(2) — e° Tult — 2T) — +++ 
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For example, since T = 0.1s, 


cBT) = c(0.3) = 201 — e& °*) — 0.363(2)(1 — e4 
—0.165(2)(1 — £?) = 0.603 


This value checks that calculated by the z-transform approach and listed in Table 6-1. We see 
then the reason for the unusual shape of c(t) in Fig. 6-1(b). This response is the superposition of 
a number of delayed step responses of the open-loop system. The steps appear as a result of the 
sampler and zero-order hold. For example, for 0 = t < 0.1s, 


c(t) = 21 — £”) 


Note that the time response of a sampled-data system of the configuration of that in Fig. 6-1(a) 
is always the superposition of a number of step responses, independent of the form of the system 
input function. The steps in the input to the plant are also shown in the plot of the zero-order hold 
output, e(t), in Fig. 6-1(c). 


Note the difficulty in calculating the continuous output c(t) as compared with calculating 
the output c(kT). For this reason, we seldom calculate the continuous output; if c(t) is needed, it 
is obtained by simulation. In fact, in practical situations, we generally calculate all time responses 
by simulation. Simulation is introduced in Section 6.6. 


EXAMPLE 6.3 


We will consider the system of Examples 6.1 and 6.2 further. Recall that the response of a 
first-order analog system has the transient-response term ke “", where 7 is the time constant. We 
see then that the analog system of Fig. 6-1(a) has a time constant of 0.167s. A rule of thumb often 
used for selecting sample rates is that a rate of at least five samples per time constant is a good 
first choice. (Later results from experimentation with the system model and the actual physical 
system may indicate that a different rate is required.) For this system, we expect that reducing 
the sample period would decrease the effects of sampling, and that the sampled-data system 
characteristics would approach those of the analog system. In fact, if T is chosen to be 0.04 s, the 
unit-step response of the sampled-data system of Example 6.1 is essentially the same as that of 
the analog system. This point is illustrated further in the next example. 

As an additional point, the final value of the unit-step response of the sampled-data system 
can be calculated using the final value theorem of the z-transform. 


lim c(aT) = [z — DC l=; = Cc 1) of) Ro) 
n>a ee 1 + G2) = 
_ G(z) Z _  2G(z) 
0) Fe ee 
(z)z— TJ fee 1 + G(Z)|2=1 
Ga) _ 2 


= 0.667 
1+ GQ) 1+2 


6.2 System Time Response 


This value checks that in Table 6-1. Note that this derivation is general. Since the system input 
is a constant value of unity, we see from this derivation that the dc gain of a stable sampled-data 
system is simply the closed-loop transfer function evaluated at z = 1 (see Section 4.3). 

A final point will be made concerning this example. For a continuous-time system whose 
output is 


C(s) = G,(s)E(s) 
the dc gain is given by (see Section 4.3) 
de gain = lim G,(s) 


and this value is G,(0) if c(t) has a final value for a constant input. In the system of Fig. 6-1(a), if 
the input to the sampler is constant, the output of the zero-order hold is also constant and equal to 
the sampler input. Thus the sampler and data hold have no effect and may be removed, resulting 
in a continuous-time system. Thus, for a stable sampled-data system, the system dc gain may be 
found by removing the sampler and data hold, and evaluating the resulting system transfer func- 
tion at s = 0. For this example, the open-loop dc gain is 


4 
GS) |,<5= Pre =2 


Thus the closed-loop de gain is 2/(1 + 2) = 0.667, which agrees with the dc gain calculated 
above via the z-transform. 


Two important points were made in this example concerning the calculation of the 
steady-state gain of a sampled-data system with a constant input applied (1.e., the calculation of 
the dc gain). First, for a stable system with a constant input, the system output approaches a con- 
stant value as time increases. The dc gain may be calculated by evaluating the transfer function 
with z = 1. Second, the same value of dc gain is obtained by evaluating the transfer function of 
the analog system (sampler and zero-order hold removed) with s = 0. This second calculation 
applies in any case that the input to the sampler is constant. 


EXAMPLE 6.4 


The system for this example is shown in Fig. 6-2. As in the first example, we will calculate the 
unit-step response. This system will also appear in many of the following examples. As was 
demonstrated in Chapter 5, the system output can be expressed as 


- G(s) > 


1 C(s) 
s(s+ 1) g 


FIGURE 6-2 System used in Example 6.4. 
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Gz) 
cam 1+ G2) ne 


where, from the tables in Appendix VI, 


co- 1 | sa Had itext- e e 
OON 2 letl Z R- 1e- 


0.368z + 0.264 
z? — 1.368z + 0.368 


Then 
G(z) _ 9.3682 + 0.264 
1+G@ 2-z+ 0.632 
Since 
Z 
SRS z= 
then 


z(0.368z + 0.264) 
(z — 1X(z? — z + 0.632) 


C(z) = = 0.3682! + 1.007? + 1.4023 


+ 1.4074 + 1.1575 + 0.9076 + 0.80277 + 0.877 

+ 0.997° + 1.08z 1° + 1.0821! + 1.037 !? + 0.987 2 

tise (6-1) 
The final value of c(nT), obtained using the final-value theorem, is 


2(0.368z + 0.264) 0.632 | 
(z — 1I? — z + 0.632) 0.632 


jim c(nT) = lim (@ — 1)C(z) = lim (z - 1) 


The step response for this system is plotted in Fig. 6-3. The response between sampling instants 
was obtained from a simulation of the system, and, of course, the response at the sampling 
instants is given in (6-1). Also plotted in Fig. 6-3 is the response of the system with the sampler 
and data hold removed. For this continuous-time system, the transfer function is, in standard 
notation [1], 

C(s) _ o2 1 


RE) 2+ Los to +s+l 


Therefore, w, = 1,6 = 0.5, and hence the overshoot is approximately 18% (see Fig. 6-4 
below). Thus, as shown in Fig. 6-3, the sampling has a destabilizing effect on the system. In 
general, it is desirable that the effects of sampling be negligible, that is, that the continuous-time 
system response and the discrete-time system response be approximately equal. For this system 


6.2 System Time Response 


Sampled-data system 


ors 
5a 


ae E as sc ee oe 


0.5 


0 2 4 6 8 10 ¢(s) 
FIGURE 6-3 Step response of the systems analyzed in Example 6.4. 
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FIGURE 6-4 Percent overshoot versus ¢. 


the sampling period and the plant time constant are equal. Hence the sampling frequency is too 
low, and should be increased, if allowed by hardware constraints. These effects will be discussed 
in detail later. 

The system time response can also be calculated using a difference-equations approach. 
From the expression for the closed-loop transfer function 


Cz) _ 0.3687! + 0.2647” 
R@  1— z! + 0.6327? 


(6-2) 
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or 
CL — z! + 0.63227] = R(z)[0.368z7! + 0.26427] (6-3) 

Taking the inverse z-transform of (6-3), we obtain the difference equation 
c(kT) = 0.368 r(kT — T) + 0.264 r(kT — 2T) + c(kT — T) — 0.632 c(kT — 2T) (6-4) 


Both c(kT) and r(kT) are zero for k < 0. Thus, from (6-4), c(0) = 0 and c(1) = 0.368. For 
k = 2, (6-4) becomes 


c(kT) = 0.632 + c(kT — T) — 0.632 c(kT — 2T) 


Solving (6-4) for c(kT) yields the same values as found in (6-1). A MATLAB program that 
solves (6-4) for the first 14 values of c(kT) is given below. Note the comparison with (6-1). 


>> $ Note that r=r (kT), rml=r(kT-T), rm2=r(kT-2T), etc. 
rm1=0; rm2=0; cml=0; cm2=0; 
for kk=1:14 
k=kk-1; 
Tery 
c=0.368*rm1+0.264*rm2+cm1-0.632*cm2; 
[k,c] 
cm2=cm1; cml=c; rm2=rml; rml=r; %Time delay 
end 
ans = 
00 
1.0000 0.3680 
Ar F 


11.0000 1.0809 
12.0000 1.0323 
13.0000 0.9812 


An additional point will be made concerning Example 6.4. The damping ratio ¢ is an 
important indicator for complex poles in a transfer function. If the transfer function is second 
order of the standard form 


Cs) _ On 
R(s) s + 2tw,S + we 


where w, is the natural frequency, the percent overshoot in the step response is given by [1]: 


Vi- x 100 


Percent overshoot = ¢¢7/ 


This relationship is plotted in Fig. 6-4. For systems that are not modeled as the standard 
second-order transfer function, Fig. 6-4 gives an indication of the overshoot (or looseness) that 
will appear in a system response if the system transfer function has complex poles. 

In this section the time responses of two different sampled-data systems were calculated 
using a z-transform approach. In addition, the continuous output was calculated for the first 


6.3 System Characteristic Equation 


example, using the Laplace transform. Because of the complexities involved, it should be evi- 
dent to the reader that in general we do not calculate the continuous output. In fact, system 
response is normally determined from either a digital simulation or a hybrid simulation of the 
system, and not from a transform approach. For high-order systems, simulation is the only prac- 
tical technique for calculating the time response. 

In many of the examples presented, the sampling frequency has been purposely chosen 
low, for two reasons. First, a sample period of 1 s is often selected to make the numerical calcu- 
lations simpler. Second, if the sample period is large, only a few terms in the series expansion 
of C(z) are required to give a good indication of the character of the response. In Example 6.4, 
if T = 0.1s, the response of the sampled-data system is approximately the same as that of the 
continuous-time system. However, for T = 0.1s, 21 terms in the series for C(z) are required to 
obtain the system response from t = 0 tot = 2s. Hence the only practical technique of calculat- 
ing the system response for this system is by simulation (which is usually the case). 


6.3 SYSTEM CHARACTERISTIC EQUATION 
Consider a single-loop sampled-data system of the type shown in Fig. 6-5. For this system, 


m 


KĪ [e = z) 


G(z)R(z 
CZ) = Aes 7 R(z) 
1 + GH(z) 
IIe = Pi) 
Using the partial-fraction expansion, we can express C(z) as 
kız kz 
CZ) = a eee + Cr) (6-5) 
z= Pi Z= Pn 


where Cp(z) contains the terms of C(z) which originate in the poles of R(z). The first n terms of 
(6-5) are the natural response terms of C(z) [i.e., the terms that are always present in C(z)]. If the 
system is stable, these terms are also called the transient response. The inverse z-transform of 
the ith term yields 


It is seen that these terms determine the nature, or character, of the system natural response. 
Since the p; originates in the roots of the equation 


1 + GH = 0 


R(s) C(s) 
æ= G(s) 


H(s) 


FIGURE 6-5 Single-loop sampled-data systems. 
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this equation is then the system characteristic equation. The roots of the characteristic equa- 
tion are the poles of the closed-loop transfer function. If a transfer function cannot be written, 
the roots of the characteristic equation are the poles of C(z) that are independent of the input 
function. 


6.4 MAPPING THE s-PLANE INTO THE z-PLANE 


In studying the characteristics of analog systems, we are able to assign time-response character- 
istics to closed-loop pole locations (characteristic-equation zero locations) [1]. It is desirable to 
be able to do the same for sampled-data systems, and this topic is discussed in this section. 

To introduce the topic, consider a function e(f), which is sampled with the resulting starred 
transform E*(s). At the sampling instants, the sampled signal is of the same nature (and has 
the same values) as the continuous signal. For example, if e(t) is exponential, then the sampled 
signal is exponential at the sampling instants, with the same amplitude and time constant as the 
continuous function. If e(f) = €“, 


Ts 
à z 


E 
, EX) =n EQ) = — 
sta (s) es — g (Z) z= g“ 


E(s) = 


Hence an s-plane pole at s = —a results in the z-plane pole at z = £ “’. In general, from the 
z-transform tables of Appendix VI, we see that a pole of E(s) at s = s, results in a z-plane pole 
of E(z) at zı = e°'”. This characteristic is also evident from the second property of the starred 
transform given in Section 3.6 and from (4-4). We will use the inverse of this characteristic. 
A z-plane pole at z = z, results in the transient-response characteristics at the sampling instants 
of the equivalent s-plane pole sı, where sı and z; are related by z; = e°". 

Consider first the mapping of the left half-plane portion of the primary strip into the z-plane 
as shown in Fig. 6-6. Along the jw axis, 


z = e = gTgT = gT = cos (wT) + j sin(wT) = 1Z0T 


jo Im(z) 


s-plane z-plane 


ORC CRS 


FIGURE 6-6 Mapping the primary strip into the z-plane. 
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Hence poles located on the unit circle in the z-plane are equivalent to pole locations on the imagi- 
nary axis in the s-plane. Thus pole locations on the unit circle in the z-plane signify a system 
with a steady-state oscillation in its natural response. From the equation above, the frequency of 
oscillation is given by the angle of the pole (in radians) divided by T. 

Forw = ,/2, wT is equal to 7, and hence the jw axis between —jw,/2 and —jw,/2 maps 
into the unit circle in the z-plane. In fact, any portion of the jw axis of length w, maps into the 
unit circle in the z-plane. The right-half-plane portion of the primary strip (see Section 3.6) maps 
into the exterior of the unit circle, and the left-half-plane portion of the primary strip maps into 
the interior of the unit circle. Thus, since the stable region of the s-plane is the left half-plane, the 
stable region of the z-plane is the interior of the unit circle. Stability will be discussed in detail 
in Chapter 7. 

Constant damping loci in the s-plane (i.e., straight lines with o constant) map into circles 
in the z-plane as shown in Fig. 6-7. This can be seen using the relationship 


z = et eT = el wT 


Constant frequency loci in the s-plane map into rays as shown in Fig. 6-8. 


te 


jo 


FIGURE 6-7 Mapping constant damping loci into the z-plane. 
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FIGURE 6-8 Mapping constant frequency loci into the z-plane. 
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For constant damping ratio loci, o and w are related by 


w t B 
— = tan 
oO 


where B is constant. Then 
a SL es. OT 
z = €" = eZ (oT tan B) (6-6) 


Since o is negative in the second and third quadrants of the s-plane, (6-6) describes a loga- 
rithmic spiral whose amplitude decreases with o increasing in magnitude. This is illustrated 
in Fig. 6-9. 

As described above, the characteristics of a sampled time function at the sampling instants 
are the same as those of the time function before sampling. Thus, using the mappings illustrated 
in Figs. 6-6 through 6-9, we may assign time-response characteristics to characteristic-equation 
zero locations in the z-plane. The correspondence of several s-plane and z-plane pole locations is 
illustrated by several examples in Fig. 6-10. The time-response characteristics of the z-plane pole 
locations are illustrated in Fig. 6-11. Since 


z= esT = ole iol 
the time-response characteristics are a function not only of s, but also of T. 
Consider the case in Fig. 6-10 that s-plane poles occur at s = o + jw. These poles result 


in a system transient-response term of the form A e™ cos (wt + b). When sampling occurs, these 
s-plane poles result in z-plane poles at 


z = eT |e tjo = CET = eT L(tT) = rZ( +8) (6-7) 


Thus roots of the characteristic equation that appear atz = rZ(+ 6) result in a transient-response 
term of the form 


AET cos(wkT + b) = A(r¥ cos (0k + ẹ) 


jo 4 N 


ay 


FIGURE 6-9 Mapping constant damping ratio loci into the z-plane. 
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FIGURE 6-10 Corresponding pole locations between the s-plane and the z-plane. 
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FIGURE 6-11 Transient response characteristics of the z-plane pole locations. 
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EXAMPLE 6.5 


As an example, the time constant that appears in the sampled transient response of the first-order 
system of Example 6.1 will be calculated. The closed-loop transfer function for this system was 
found to be 


G(z) 0.3625 
1+ G(z) z — 0.4562 


Hence the closed-loop characteristic equation is 
z — 0.4562 = 0 


From Fig. 6-10, we see that a pole at z = 0.4562 corresponds to an s-plane pole sı on the nega- 
tive real axis that satisfies 


zı = 0.4562 = ef? = g1 


Hence sı = In (0.4562)/0.1, or s, = —7.848. Since the time constant is the reciprocal of the 
magnitude of a real pole in the s-plane, the closed-loop system has the time constant T = 0.127 s. 
(From Example 6.3 the time constant of the system with the sampling removed is 0.167 s.) Also, 
since the transient response settles out in approximately four time constants, the transient 
response of this system will settle in approximately 0.5 s. This characteristic is seen in the step 
response of Fig. 6-1(b). 


In the discussion above, we considered the relationship between s-plane poles and z-plane 
poles in a general way. We will now mathematically relate the s-plane pole locations and the 


z-plane pole locations. We express in standard form the s-plane second-order transfer function 
G(s) = 

Ss) = —,!,!, 

x + 24m, + o2 


which has the poles 
s512 = —Cow, a jon vl- Cc 
where ¢ is the damping ratio and w, is the natural frequency. The equivalent z-plane poles occur at 


z= eT |, = & "LZ (ta,TV1 — 07) = Zr( +0) 


Hence 
e607 = r 
or 
Cw,T = —Inr 
Also, 


oT V1-C=80 


Taking the ratio of the last two equations, we obtain 


C _ lnr 
1- g 0 


6.4 Mapping the s-Plane into the z-Plane 


Solving this equation for ¢ yields 


—Inr 
i= E (6-8) 
V (Inr + 6 
We then find w, to be 
1 2 2 
o, = 7y (Inr)? + 90 (6-9) 
The time constant, t, of the poles is then given by 
T= A = (6-10) 
On nr 
This equation can also be expressed as 
r= sT" 


Thus, given the complex pole location in the z-plane, we find the damping ratio, the natural 
frequency, and the time constant of the s-plane pole from (6-8), (6-9), and (6-10), respectively. 


EXAMPLE 6.6 


For this example we will consider the system of Example 6.4. For this system the closed-loop 
transfer function was calculated to be 


GZ) _ 0.368z + 0.264 
1 +G) z — z +0632 


Thus the system characteristic equation is 
z — z + 0.632 = (z — 0.5 — j0.618)(z — 0.5 + j0.618) = 0 
The poles are then complex and occur at 


z =0.5 + j0.618 = 0.7954 (+ 51.0°) = 0.795°/ (+ 0.890 rad) 
Since, in (6-8), (6-9), and (6-10), 


z = &T/(+ oT) = r4L(+oT) = 0.7954 (+ 0.890) 
then 
—In 0.795 


a [din 0.795)" + (0.890)2] "2 = 0.250 


z 1 2 21/2 — 
On i [Un 0.795) + (0.890)*] 0.9191 rad/sec 


=] 
C= — 
In 0.795 


4.36s 
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The equivalent values for the closed-loop analog system (with sampler and data hold removed) 
were found in Example 6.4 to be ¢ = 0.50 and w, = 1 rad/s. Also t = 1/Cw, = 2 s. Hence 
the effects of the sampling are seen to be destabilizing. However, if T = 0.1 s, there is little 
effect from the sampling. From Problem 6.4-3, the parameters for this case are ¢ = 0.475, 
w, = 0.998 rad/s, and T = 2.11 s. 


A word is in order concerning the probable location of characteristic-equation zeros. 
Transfer-function pole locations in the s-plane transform change into z-plane pole locations as 


st1/1 > z-e 


(st 1/tP +o? > 2 = 2c coswT + © 2" = (z -zaz - z) 
where 
q = e eT =e Zur = 726 


The s-plane time constant for the real pole is t. In order for the sampling to have negligible 
effect, T must be much less than t. Thus for the real pole, the z-plane pole location will be in the 
vicinity ofz = 1, since T/r is much less than 1. For the complex pole, an additional requirement 
is that several samples be taken per cycle of the sinusoid, or that wT < 1. Thus, once again, 
T << q, and since zz; = e777" then lal = e T^ and the z-plane pole locations again will be in 
the vicinity of z = 1. In general, for a discrete-time control system, the transfer-function pole 
locations (characteristic-equation zero locations) are placed in the vicinity of z = 1, if system 
constraints allow a sufficiently high sample rate to be chosen. 
The ideas in the foregoing paragraph can be expressed mathematically. From (6-10), 


T 1 

epee anata 6-11 

T Inr ( ) 
We see that the ratio T/T is simply the number of samples per time constant. For example, if 
t = 1 sand T = 0.25 s, then we have four samples per time constant. Equation (6-11) is tabu- 
lated for certain values of r in Table 6-2. 


TABLE 6-2 Tabulated Values for (6-11) and (6-12) 


Samples per time constant Samples per period 

r T/T 0° T,/T 
0.999 999.5 10° 36 
0.99 99.5 20° 18 
0.95 19.5 30° 12 
0.9 9.5 45° 8 
0.8 4.48 60° 6 
0.7 2.80 90° 4 
0.6 1.96 120° 3 
0.4 1.09 180° 2 
0.2 0.62 


6.5 Steady-State Accuracy 


In a like manner, we can manipulate the equation wT = 9 to obtain the number of samples 
per cycle of the sinusoid. Thus 
_ 2m 


oT = —T=0 
T4 


where Ty is the period of the sinusoid and 9 is in radians. Hence 


T, 2m 360° 


T 0 6° 


(6-12) 


where 0° denotes © in degrees. Equation (6-12) is also tabulated for certain values of @ in 
Table 6-2. 


6.5 STEADY-STATE ACCURACY 


An important characteristic of a control system is its ability to follow, or track, certain inputs 
with a minimum of error. The control system designer attempts to minimize the system error to 
certain anticipated inputs. In this section the effects of the system transfer characteristics on the 
steady-state system errors are considered. 

Consider the system of Fig. 6-12. For this system, 


Ce) GO 
RZ) 1+ GQR) 


(6-13) 


where G(z) = š[G(s)]. The plant transfer function can always be expressed as 


K][@- z) 
G(z) = > . eed g#l (6-14) 
c-DT[@- 4 


As we shall see, the value of N has special significance and is called the system type. For conve- 
nience in the following development, we define 


m 


K][@ - z) 
=- 
Ie- z l 


Kac (6-15) 


R) + E(s) Be C(s) 
al s 


FIGURE 6-12 Discrete-time system. 
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Note that K,, is the open-loop plant dc gain with all poles at z = 1 removed. 
For the system of Fig. 6-12, the system error, e(t), is defined as the difference between the 
system input and the system output. Or 


E(z) = gle] = RC) — CR) (6-16) 
Then, from (6-13) and (6-16), 
= GQ) _ R 
RRN Gey Ge) 


The steady-state errors will now be derived for two common inputs—a position (step) 
input and a velocity (ramp) input. First, for the unit-step input, 


_ 2 
aaa 


Then, from the final-value theorem, the steady-state error is seen to be 


=A 7 2a = DRR) 
e.(kT) = lim z- DER) = lim TFG (6-17) 


provided that e,,(kT) has a final value. The steady-state error is then 


(kT) = li £ : 

- = hm — 

ss 11+ GQ) 1+ limG@) 
Z— 


We now define the position error constant as 
Kp = lim G(z) (6-18) 
> 
Then in (6-14), if N = 0 [i.e., no poles in G(z) atz = 1], K, = Kac and 


1o 1 
+Kp 1+ Ky 


ess(kT) = 5 (6-19) 


For N = 1 (system type greater than or equal to one), Kp = © and the steady-state error is zero. 
Consider next the unit-ramp input. In this case r(t) = t, and from Appendix VI, 


Tz 


R(z) = Gaj 2492 


Then, from (6-17), 


A Tz T 
é (kT) = lim iat 
zl(z — 1) + (z — IG(Z) lim @ — 1)G(z) 


We now define the velocity error constant as 


K, = lim =(¢ — 1)G() (6-20) 
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Then if N = 0, K, = Oande,(kT) = ©. For N = 1, K, = Kg,/T and 


A ES (6-21) 


For N = 2 (system type greater than or equal to 2), K, = © and e,,(kT) is zero. 

The development above illustrates that, in general, increased system gain and/or the 
addition of poles at z = 1 to the open-loop forward-path transfer function tend to decrease 
steady-state errors. However, as will be demonstrated in Chapter 7, both large gains and 
poles of G(z) at z = 1 have destabilizing effects on the system. Generally, trade-offs exist 
between small steady-state errors and adequate system stability (or acceptable system tran- 
sient response). 


EXAMPLE 6.7 
The steady-state errors will be calculated for the system of Fig. 6-12, in which the open-loop 


function is given as 
a = | K | 
3 s lss +D 


Thus 


5 sae jaiei l | 
GEE an E eD 


Kz — Dzie + T- 1z + (1 -€ - Te”) 
z z- Pe- Ee” 


TE +T- De ae Se) 
= Dee) 


Then, from (6-14) and (6-20), the system is type 1 and 


g- Ke +T- 1) +d- eT- Te] 


K 
woer TA — £5 


Since G(z) has one pole at z = 1, the steady-state error to a step input is zero, and to a ramp 
input is, from (6-21), 
1 1 


kT) = > Hs 
esl ) K, K 


provided that the system is stable. The question of stability is considered in Chapter 7. 
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EXAMPLE 6.8 


As a second example, consider again the system of Fig. 6-12, where, for this example, 
{= | o bee? 
s(s + 1) 


G(z) = | = z 
(z) 5 | 

Suppose that the design specification for this system requires that the steady-state error to a unit 

ramp input be less than 0.01. Thus, from (6-20), it is necessary that the open-loop system be type 

1 or greater and thus the open-loop function must have at least one pole at z = 1. Since the plant 

does not contain a pole at z = 1, a digital compensator of the form 


DO) = Kız 


+ K; 
1 P 


can be added, to produce the resultant system shown in Fig. 6-13. 

The compensator, called a PI or proportional-plus-integral compensator, is of a form com- 
monly used to reduce steady-state errors. This compensator is discussed in Chapter 8. For this 
system (6-20) becomes 


K, = lim ae — 1)D(z2)G(z) 
z>I T 


Employing the expressions above for D(z) and G(z), we see that 


K; + Kp)z — Kp] 1 —e 7 K, 
kemp- y 4 i =— 
ZI T(z — 1) ze T 


Thus K; equals 1007 for the required steady-state error, provided that the system is stable. The 
latter point is indeed an important consideration since the error analysis is meaningless unless 
stability of the system is guaranteed. Chapter 7 illustrates a number of techniques for analyzing 
system stability. This system is considered further in Example 7.6. 


Rs) 4 C(s) 
7 Diz) ~~~ G(s) 


FIGURE 6-13 System for Example 6.8. 


6.6 SIMULATION 


Thus far we have determined the time response of a system via a transform approach. In 
Example 6.1 we determined the system response at the sampling instants using the z-transform. 
A Laplace transform technique for calculating the system response for all time was also 
illustrated. 


6.6 Simulation 


A different approach for determining a system’s response is through simulation. The simu- 
lation of a continuous-time (analog) system may be via the integration of the system’s differ- 
ential equations using electronic circuits. An analog computer can be designed to perform this 
function. The interconnection of a digital computer with the analog computer is called a hybrid 
system. The analog parts of the control system can be simulated on the analog computer with the 
digital controller simulated on the digital computer. If a numerical algorithm is used to integrate 
an analog system’s differential equations on a digital computer, we then can eliminate the analog 
computer and perform a digital simulation of the entire system. This is the type of simulation that 
we consider here. 

The problem of numerical integration of a time function can be illustrated using Fig. 6-14. 
We wish to integrate y(t) numerically; that is, we wish to find x(t), where 


x(t) = f y(t)dt + x(0) (6-22) 
0 


Suppose that we know x[(k — 1)H] and we want to calculate x(kH), where H is called the numer- 
ical integration increment and is the step size in the algorithm. Perhaps the simplest numer- 
ical integration algorithm is obtained by assuming y(f) constant at the value y[(k — 1)H] for 
(k — 1)H St < kH. Then 


x(kH) = x[(k — 1)H] + Hy[(k — 1)H] (6-23) 


Of course, x(kH) in (6-23) is only an approximation to x(t) in (6-22) evaluated at t = kH. Note 
in Fig. 6-14 that we are approximating the area under the y(t) curve for (k — 1)H = t < kH 
with the area of the rectangle shown. For this reason, this numerical integration algorithm is 
called the rectangular rule, and is also known as the Euler method. 

We are interested in the integration of differential equations [i.e., in (6-22), y(t) = xH]. 
We will illustrate this case with a simple example. Suppose that we wish to solve the differential 
equation 


x(t) + x(t) = 0, x(0) = 1 (6-24) 
The solution is obviously 


x(t) =e 


y(t) 


x 
Lis 


(k-DH kH 


FIGURE 6-14 Rectangular rule for numerical integration. 
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However, by numerical integration in (6-23), 
x(kH) = x[(k — 1)H] + Al—x[(k — 1)H]] (6-25) 
since, from (6-24), for this differential equation 
y(t) = XÀ = xÀ 


Suppose that we chose H = 0.1 s. Then, solving (6-25) iteratively starting with k = 1 
[we know x(0)], 


x(0.1) = x(0) — Hx(0) = 1.0 — (0.1)(0.1) = 0.9 
x(0.2) = x(0.1) — Hx(0.1) = 0.9 — 0.09 = 0.81 
x(1.0) = x(0.9) — Hx(0.9) = 0.3487 
Since, for this example, we know the solution, we calculate x(t) att = 1.0 s as 
x(1.0) = e}° = 0.3678 


and we can see the error due to the numerical integration. 

In the example above, if we choose H larger, the error is larger. If we decrease H, the error 
decreases to a minimum value. Then a further decrease in H will result in an increase in the error, 
due to round-off in the computer. With H equal to 0.1 s, 10 iterations are required to calculate 
x(1). With H = 0.001 s, 1000 iterations are required to calculate x(1). The round-off errors in 
the computer are larger for the latter case, since more calculations are made. If H is made suf- 
ficiently smaller, this round-off error becomes appreciable. 

Next we will consider the simulation of an analog system. Assume that the system’s state 
equations are given by 


x(t) = Ax + Bu) (6-26) 


Then (6-22) becomes 


x(t) = : x(t)dt + x(0) (6-27) 
0 


and the rectangular rule for x(f) a vector becomes 
x(kH) = x[(k — 1)H] + Hx[(k — 1)H] (6-28) 

where, from (6-26), 
š[(k — DH] = Ax[(k — DH] + Bu[(k — 1)H] (6-29) 


The numerical integration algorithm becomes: 


1. Letk = 1. 
2. Evaluate x[(k — 1)H] in (6-29). 


6.6 Simulation 


3. Evaluate x(k) in (6-28). 
4. Letk=k+1. 
5. Go to step 2. 


Refer again to Fig. 6-14. This figure illustrates the rectangular rule for numerical integra- 
tion. Other numerical integration algorithms differ from this rule in the manner that x[kH] is 
calculated, based on the knowledge of x[(k — 1)H]. As an example of a different algorithm, 
consider the trapezoidal rule illustrated in Fig. 6-15. The integral for [(k — l)H]=t < kH is 
approximated by the area of the trapezoid. For this rule, with x(t) equal to the integral of y(t), 


ylk — 1)H] + y(kB) 


x(kH) = x[(k — 1)H] + H 5 (6-30) 
For y(t) equal to x(t), then 
x(kH) = x[(k — 1)H] + HEU — 1)H] + x(kH)] (6-31) 


Since x[(k — 1)H] is known, x[(k — 1)H] can be calculated from the differential equation that is 
to be solved. However, we cannot calculate x(kH) without a knowledge of x(kH). A method for 
solving this problem will now be presented. 

We use a different rule to “predict” the value of x(kH). Using this predicted value, we cal- 
culate the predicted value of x(kH), and substitute this value in the trapezoidal rule to “correct” 
the value of x(kH). A method of this type is called a predictor-corrector algorithm. A commonly 
used rule for prediction is the rectangular rule. 

The state model of an analog system given in (6-26) will be used to illustrate the trap- 
ezoidal rule. It is assumed that x[kKH] is known for k = 0, and thus x[kH] is to be calculated for 


k = 1,2,3, ... . The predictor algorithm, which is the rectangular rule, is given by 
x[(k — DH] = A.x[(k — 1)H] + Bulk — DH] (6-32) 
x(kH) = x[(k — 1H] + Ax[(k — DH] (6-33) 


y(t) 4 


(k— DH kH t 


FIGURE 6-15 Trapezoidal rule for numerical integration. 
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The corrector algorithm is given by 
x(kH) = A.x(kH) + B.u(k#) (6-34) 


x(kH) = x[(k — 1)H] + fia — 1)H] + x(kH)] (6-35) 


The predicted value of x(kH) is given by (6-33), and the corrected, and final, value of x(kH) is 
given by (6-35). Thus, the numerical integration algorithm is given by: 


1. Letk = 1. 

. Evaluate x[(k — 1)H] in (6-32). 

. Evaluate x(k) in (6-33). 

. Evaluate x(kH) in (6-34), using the result of step 3. 
. Evaluate the final value of x(k) in (6-35). 

. LetkK=k+ 1. 

. Go to step 2. 


NAMB WN 


This algorithm obviously requires more calculations per iteration than does the rectangular 
rule. However, for a specified accuracy of the solution, a much larger increment H may be used 
such that the total computer execution time for the trapezoidal rule is less than that for the rect- 
angular rule. The trapezoidal rule will now be illustrated by an example. 


EXAMPLE 6.9 


Consider once again the differential equation 
x(t) + x(t) = 0, x(0) = 1 


which has the solution 


x(t) =e 
Since 
x(t) = —x(t) 
implementing the trapezoidal rule for H = 0.1 s yields 
K=1: 
x(0) = —x(0) = -1 
x(0.1) = x(0) + Ax(0) = 1 + 0.1(-1) = 0.9 
x(0.1) = —x(0.1) = —0.9 
x(0.1) = x(0) + A/2[x(0) + x(0.1)] 
= 1+ 0.05(-1 — 0.9) = 0.905 
K=2 


x(0.1) = —x(0.1) = —0.905 
x(0.2) = x(0.1) + Hx(0.1) = 0.905 — 0.0905 = 0.8145 


6.8 Summary 


(0.2) = —x(0.2) = —0.8145 
x(0.2) = x(0.1) + H/2[X(0.1) + (0.2) 
= 0.905 + 0.05(—0.905 — 0.8145) = 0.8190 


for the first two iterations. If these calculations are continued, we find x(1.0) to be 0.3685. Recall 
that the exact value of x(1) is 0.3678, and the value of x(1) calculated above using the rectangular 
tule is 0.3487. Hence much greater accuracy results from use of the trapezoidal rule as compared 
with the rectangular rule, but at the expense of more calculations. If H is increased to 0.333 s, 
x(1) is calculated to be 0.3767 with the trapezoidal rule. Here the accuracy is still significantly 
greater than that of the rectangular rule with H = 0.1 s, although the amount of calculations 
required is approximately the same. 


In the discussion above, only two of many numerical integration rules were discussed. 
One of the more commonly used rules for digital simulation is the fourth-order Runge-Kutta 
rule [2—4]. The interested reader is referred to the many texts available in this area. 

Two additional points concerning simulation should be made. First, in digital simula- 
tions we approximate differential equations by difference equations and solve the difference 
equations. Thus we are replacing a continuous-time system with a discrete-time system that has 
approximately the same response. 

The second point is that, in the simulation of nonlinear systems, the nonlinearities appear only 
in the calculation of x[(k — 1)H], given x[(k — 1)H]. If the nonlinearities are of a form that can be 
easily expressed in a mathematical form, the simulation is not appreciably more difficult to write. 

In the discussion above, we considered the simulation of analog systems only. The addition 
of a sampler and zero-order hold to an analog system requires that logic be added to the system 
simulation. The logic will hold the zero-order-hold output constant over any sample period, and 
equal to the value of sampler input at the beginning of that sample period. The addition of a digi- 
tal controller requires that the controller difference equation be solved only at the beginning of 
each sample period, and that the controller output then remain constant over the sample period. 


6.7 CONTROL SOFTWARE 


Many commercial analysis and design control software packages are available; these packages 
have simulation capabilities of varying degrees. We employ MATLAB in this text. In general, 
the analog components in a digital control system are entered into the control software programs 
as transfer functions or state equations. Most packages will accept either model and then cal- 
culate the other model from the one given. If the digital controller is known, it is entered as a 
transfer function or, in some cases, as a state model. The packages can then simulate the system. 
In general, the packages have a number of numerical integration algorithms available; the user 
must choose one of these algorithms or accept the programs default selection. 


6.8 SUMMARY 


The time response of discrete-time closed-loop systems has been discussed. Both steady-state and 
transient responses have been considered. The correlation between the s-plane and the z-plane 
which has been presented provides a mechanism for the transfer of many of the continuous-system 
tools needed for both the analysis and design of closed-loop discrete-time systems. Finally, a 
brief introduction into the digital simulation of systems has been presented. 
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(a) Calculate and plot the unit-step response at the sampling instants, for the case that D(z) = 1. 

(b) Calculate the system unit-step response of the analog system, that is, with the sampler, digital control- 
ler, and data hold removed. Plot the response on the same graph with the results of part (a). 

(c) For the system of Fig. P6.2-1, let D(z) = 1 and T = 0.4 s. Calculate the unit-step response and plot 
these results on the same graph used for parts (a) and (b). 

(d) Use the system dc gains to calculate the steady-state responses for each of the systems of parts (a), (b), 


and (c). Why are these gains equal? 


R(s) -Ts 
i) t -| DO 1-e® 0.5 
` T=2s S s+0.5 


C(s) 


FIGURE P6.2-1 System for Problem 6.2-1. 


6.2-2. Consider the system of Fig. P6.2-1, with D(z) = 1. Use the results of Problem 6.2-1 if available. 
(a) Find the system time constant t for T = 4s. 
(b) With the input a step function, find the time required for the system output c(kT) to reach 98 percent of 
its final value, for T = 4 s. Recall that four time constants (47) are required. 
(c) Repeat parts (a) and (b) for T = 0.6s. 
(d) Repeat parts (a) and (b) for the analog system, that is, for the system with the sampler and data hold 
removed. 
6.2-3. In Example 6.1 the response of a sampled-data system between sample instants was expressed as a sum of 
delayed step responses. 
(a) Use this procedure to find the system output y(t) of Fig. P6.2-1 att = 1s. 
(b) Repeat part (a) att = 3 s. 
(c) The equation for c(t) in part (a) and that for c(t) in part (b) should give the same value at t = 2 s. Why? 
Hint: Consider the step response of the analog plant. 
(d) Show that the statement in part (c) is true. 
6.2-4. 


Shown in Fig. P6.2-4 is the block diagram of a temperature control system for a large test chamber. This 


system is described in Problem 1.6-1. Ignore the disturbance input for this problem. 
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FIGURE P6.2-4 Chamber temperature control system. 


(a) 


(b) 
(c) 
(d) 


With D(z) = 1 and T = 0.6 s, evaluate and plot the system response if the input is to command a 10°C 
step in the output. Note that the system input must be a step function with an amplitude of 0.4 V. Why? 
Use the results of part (a) to plot the output of the zero-order hold. 

Solve for the steady-state output for part (a). 

Suppose that the gain of 2 in the plant is replaced with a variable gain K. What value does the output 
approach in the steady state as K becomes very large? Assume that the system remains stable as K is 
increased (an unrealistic assumption). 


6.2-5. Consider the temperature control system of Problem 6.2-4 and Fig. P6.2-4. 
(a) Let T = 5 s, and solve for the response to the input R(s) = 0.2 s~}. Plot this response on the same 
graph with the response found in Problem 6.2-4. Note the effects of increasing T from 0.6 s to 6 s, when 
the plant has a time constant of 2 s. 
(b) Find c(t) for O = t = 6s. This response can be calculated without the use of the z-transform. 
6.2-6. Consider the system of Fig. P6.2-4, with D(z) = 1. Use the results of Problems 6.2-4 and 6.2-5 if 
available. 
(a) Find the system time constant t for T = 0.8 s. 
(b) With the input a step function, find the time required for the system output c(kT) to reach 98 percent of 
its final value. Note that this time is approximately four time constants (47r). 
(c) Repeat parts (a) and (b) for T = 8 s. 
(d) Repeat parts (a) and (b) for the analog system, that is, for the system with the sampler and data hold 
removed. 
6.2-7. The block diagram of a control system of a joint in a robot arm is shown in Fig. P6.2-7. This system is 
discussed in Section 1.6. Let T = 0.1 s and D(z) = 1. 
Power 
Controller amplifier Servomotor Gears 
9. + H DY) Zero-order K Ea l 200 O, -l 1 Oa 
\ T , hold N Uf s (0.5s+1) 100 
Volts 
Sensor 
Volts 
0.07 


FIGURE P6.2-7 Robot arm joint control system. 
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6.4-1. 


6.4-2. 


R(s) 


r(t) 


FIGURE 


6.4-3. 


6.4-4. 
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(a) Evaluate C(z) if the input is to command a 20°C step in the output and K = 10. Note that the system 
input must be a step function with an amplitude 1.4 V. Why? 

(b) Assuming the system to be stable, find the steady-state system output. 

(c) Find the (approximate) time required for the system response to reach steady state. 

(d) Simulate the system to verify the results in parts (b) and (c). 

The block diagram of a control system of a joint in a robot arm is shown in Fig. P6.2-7. Let T = 0.1 s, 

K = 20, and D(z) = 1. The results of Problem 6.2-7 are useful in this problem if these results are available. 

(a) Find the damping ratio ¢, the natural frequency w,, and the time constant t of the open-loop system. If 
the system characteristic equation has two real zeros, find the two time constants. These values can be 
solved by inspection. Why? 

(b) Repeat part (a) for the closed-loop system. 

(c) Repeat parts (a) and (b) for the system with the sampler, digital controller, and data hold removed, that 
is, for the analog system. 

(d) Use the results in parts (b) and (c) to find the percent overshoot in the step responses for the sampled-data 
closed-loop system and for the analog closed-loop system. 

The block diagram of an attitude control system of a satellite is shown in Fig. P6.4-2. Let T = 1 s, K = 200, 

J = 0.2, H, = 0.04, and D(z) = 1. 

(a) Find the damping ratio ¢, the natural frequency w,, and the time constant t of the open-loop system. If 
the system characteristic equation has two real zeros, find the two time constants. These values can be 
solved by inspection. Why? 

(b) Repeat part (a) for the closed-loop system. 

(c) Repeat parts (a) and (b) for the system with the sampler, digital controller, and data hold removed, that 
is, for the analog system. 

(d) The closed-loop sampled-data system is seen to be unstable and the closed-loop analog system is seen 
to be marginally stable. If the satellite is operated with each of these control systems, describe the 
resulting movement for both the sampled-data system and the analog system. 


Digital Amplifier and 
Controller thrusters Satellite 
4 M(s) TCs) 1 0(s) 
A/D D(z) DIA K or 
È Torque Jst oA) 
Sensor 
H, \« 


P6.4-2 Block diagram for a satellite control system. 


It is shown in Example 6.6 that the system of Fig. 6-2 has the parameters € = 0.250, w, = 0.9191, and 

T = 4.36s. 

(a) Find ¢, w,, and t for the sample period T = 0.5. 

(b) Repeat part (a) for T = 0.1. 

(c) Repeat part (a) for the analog system, that is, the system with the sampler and data hold removed. Note 
that this case can be considered to be the limit as the sample period approaches zero. 

(d) Give a table listing the three parameters as a function of sampling frequency f, = 1/T. State the result 
of decreasing the sampling frequency on the parameters. 

Consider the system of Fig. P6.4-4. This system is called a regulator control system, in which it is desired 

to maintain the output, c(t), at a value of zero in the presence of a disturbance, f(t). In this problem the 

disturbance is a unit step. 
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(a) With D(z) = 1 (i.e., no compensation) find the steady-state value of c(t). 
(b) For f(t) to have no effect on the steady-state value of c(kT), D(z) should have a pole at z = 1. Let 


0.1z 
= i 


Dz) =1+ 
Zz 
Determine the steady-state value of c(AT). 


(c) Repeat parts (a) and (b) with T = 1s. 
(d) Why does the value of sample period T have no effect on the steady-state response for a constant input? 


fO = u(t) 


| 
m 
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c(t) 
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FIGURE P6.4-4 System for Problem 6.4-4. 


6.4-5. 


6.4-6. 


6.5-1. 


Consider the sampled-data systems with the following characteristic equations: 


G) z— 0.199 = 0 (v) z2- 1.9z+ 0.9 =0 
Gi) z — 0.99 = 0 (vi) 2 -1=0 
Gii) z- 0.19 = 0 (vii) 2 — 2z + 0.99 = 0 


(iv) z+0.9=0 

(a) What can you determine about the system natural-response characteristics for each system, for 
T = 0.25s? 

(b) Repeat part (a) for T = 2 s. 

(c) For a given characteristic equation as a function of z, which parameters of the transient response vary 
with the sample period 7, and which are independent of T? 

Consider the system of Fig. P6.2-1. Suppose that an ideal time delay of 0.2 s is added to the plant, such that 

the plant transfer function is now given by 


0.5¢°0:2F 


= ai 


(a) Find the time constant t of the system if the time delay is omitted. 
(b) Find the time constant t of the system if the time delay is included. 
(c) Repeat part (b) for a time delay of 1 s. 
(d) What is the effect on the speed of response of the closed-loop system of adding time delay to the plant? 
(a) Give the system type for the following systems, with D(z) = 1. It is not necessary to find the pulse 
transfer functions to find the system type. Why? 
(i) Fig. P6.2-1. 
(ii) Fig. P6.2-4. 
(iii) Fig. P6.2-7. 
(iv) Fig. P6.4-2. 
(v) Fig. P6.4-4. 
(b) It is desired that the systems of part (a) have zero steady-state error for a constant input. Give the 
required characteristics for each digital controller. 
(c) It is desired that the systems of part (a) have zero steady-state error for a ramp input. Give the required 
characteristics for each digital controller. 
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6.5-2. 
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Consider the system of Fig. P6.5-2. The digital filter is described by 
mkT) = e(kT) — 1.9e[(k — 1)T] + m[(k — 1)T] 


(a) Find the system type. 

(b) Find the steady-state response for a unit-step input, without finding C(z). 
(c) Find the approximate time for the system to reach steady state. 

(d) Find the unit-step response for the system and verify parts (b) and (c). 


G(s) 
R(s) 4 Ts | MO) 1 Cs) 
= D(z) T 1 E€ | > 

\ T= 1s F s+2 


FIGURE P6.5-2 System for Problem 6.5-2. 


6.5-3. 


6.5-4. 


6.5-5. 


6.5-6. 


6.6-1. 


6.6-2. 


Consider the system of Fig. P6.5-2, with the digital filter as described in Problem 6.5-2. 
(a) Find the system type. 

(b) Find the steady-state response for a unit ramp input, without finding C(z). 

(c) Find the approximate time for the system to reach steady state. 

(d) Calculate the steady-state unit-ramp response for the system to verify parts (b) and (c). 
Consider the system of Problem 6.5-2. Let the plant transfer function be given by 


s 
Sl 


G,(s) = 


Hence the dc gain of the plant is zero. The digital filter is as given in Problem 6.5-2. 

(a) Find the system type. 

(b) Find the steady-state response for a unit-step input, without finding C(z). 

(c) Find the approximate time for the system to reach steady state. 

(d) Find c(kT) and verify the results of parts (b) and (c). 

For the system of Fig. 6-13, G,(s) = 20(s + 5) /(s(s + 4)(s + 6)), with T = 0.05 and D(z) implementing 
the following difference equation 


m(k) = 10e(k) — 16e(k — 1) — 6.3e(k — 2) + m(k — 1) 


(a) Find the system type. 

(b) Plot the unit-step response. 

(c) Find the rise time, overshoot, and settling time. 

Repeat Problem 6.5-5 with T = 0.02. 

(a) Find the system type. 

(b) Plot the unit-step response. 

(c) Find the rise time, overshoot, and settling time. 

(d) Compare your results with those of Problem 6.5-5 and explain any differences. 

Consider the system of Fig. P6.5-2, with D(z) = 1. 

(a) With the sampler and zero-order hold removed, write the system differential equation. 

(b) Using the rectangular rule for numerical integration with the numerical integration increment equal to 
0.25 s, evaluate the unit-step response for 0 = t = 1.5s. 

(c) Repeat part (b) with the sampler and zero-order hold in the system, and with a sample period T = 0.5 s. 

(d) Solve for the exact unit-step responses for parts (b) and (c), and compare results. 

Consider the numerical integration of the differential equation (6-24) in Section 6.6. Applying the rectan- 

gular rule results in the difference equation (6-25), which can be expressed as 


x(k + DH] = x(kH) + Hl-x(kH)] 


6.6-3. 


6.6-4. 


6.6-5. 


6.6-6. 
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(a) Use the z-transform to solve this equation as a function of x(0) and H. 
(b) Use the results of part (a) to show that as given in Section 6.6, x(1.0) = 0.3487 with x(0) = 1 and 
H = 0.1. 
(c) Solve for x(1.0) with x(0) = 1 and H = 0.01. 
(d) The exact value of x(1.0) is given in Section 6.6. Compare the errors in the results of parts (b) and (c). 
Consider the numerical integration of the differential equation 
dx(t) à 
a F x(t) =r (ft) 
using the rectangular rule. 
(a) Develop the difference equation, as in (6-25), for the numerical integration of this differential equation. 
(b) Let r(t) = 1, x(0) = 0, and H = 0.1. Use the z-transform to solve the difference equation of part (a) 
for x(1.0). 
(c) Repeat part (b) for H = 0.01. 
(d) Solve the given differential equation, using the Laplace transform, for the exact value of x(1.0). 
(e) Compare the errors in the results in parts (b) and (c). 
Consider the numerical integration of the differential equation 


dx(t) 
dt 


+ x(t) = 0 


using the predictor-corrector of Section 6.6. The predictor method is the rectangular rule, and the corrector 

method is the trapezoidal rule. 

(a) Develop the difference equation, using (6-32) through (6-35), for the numerical integration of the given 
differential equation. The result should be one difference equation for x[(k + 1)H] as a function of 
x(kH). 

(b) Let x(0) = 1, and H = 0.1. Use the z-transform to solve the difference equation of part (a) for x(1.0). 
This value is given as 0.3685 in Example 6.9. 

(c) Repeat part (b) for H = 0.33333. This value is given as 0.3767 in Example 6.9. 

(d) Solve the given differential equation, using the Laplace transform, for the exact value of x(1.0). 

(e) Give the errors in the results in parts (b) and (c). 

Consider the numerical integration of the differential equation 

dx(t) = 
re + x(t) = r(t) 

using the predictor-corrector of Section 6.6. The predictor method is the rectangular rule, and the corrector 

method is the trapezoidal rule. 

(a) Develop the difference equation, using (6-32) through (6-35), for the numerical integration of the 
given differential equation. The result should be one difference equation for x(kH) as a function of 
x[(k — 1)H] and the input function r[(k — 1)H]. 

(b) Let r(t) = 1, x(0) = 0, and H = 0.1. Use the z-transform to solve the difference equation of part (a) 
for x(1.0). 

(c) Repeat part (b) for H = 0.33333. 

(d) Solve the given differential equation, using the Laplace transform, for the exact value of x(1.0). 

(e) Give the errors in the results in parts (b) and (c). 

Repeat Problem 6.6-1, but with the process transfer function given by 


20 


G) = aye D 


Solve for the unit-step responses for 0 = t = 1.0 s. 
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Stability Analysis Techniques 


7.1 INTRODUCTION 


In this chapter stability analysis techniques for linear time-invariant (LTI) discrete-time systems 
are emphasized. In general, the stability analysis techniques applicable to LTI continuous-time 
systems may also be applied to the analysis of LTI discrete-time systems, if certain modifica- 
tions are made. These techniques include the Routh—Hurwitz criterion, root-locus procedures, 
and frequency-response methods; these techniques are developed in this chapter. The Jury stabil- 
ity test, a technique developed for LTI discrete systems, is also presented. 


7.2 STABILITY 


To introduce the concepts of stability, consider the LTI system shown in Fig. 7-1. For this system, 


core — KIIG-« 
1+GH2 Æ 


IIe- p) 


where z; are the zeros and p; the poles of the system transfer function. Using the partial-fraction 
expansion, for the case that the transfer-function poles are distinct, we can express C(z) as 


C(z) = R(z) 


C(z) = a Peep knz 4 CR) (7-1) 


Pı Z= Pn 
where CR(z) contains the terms of C(z) which originate in the poles of R(z). The first n terms of 
(7-1) are the natural-response terms of C(z). If the inverse z-transform of these terms tends to 
zero as time increases, the system is stable, and these terms are called the transient response. The 
inverse z-transform of the ith term is 


| Kz | pe k 
3 | eel S ki(pi) (7-2) 


7.2 Stability 


R(s) C(s) 
f T G(s) 


H(s) 


FIGURE 7-1 Sampled-data system. 


Thus, if the magnitude of p; is less than 1, this term approaches zero as k approaches infinity. 
Note that the factors (z — p;) originate in the characteristic equation of the system, that is, in 


1+ GH) = 0 (7-3) 


The system is stable provided that all the roots of (7-3) lie inside the unit circle in the z-plane. Of 
course, (7-3) can also be expressed as 


1 + GH*(s) = 0 (7-4) 


and since the area within the unit circle of the z-plane corresponds to the left half of the s-plane, 
the roots in (7-4) must lie in the left half of the s-plane for stability. The system characteristic 
equation may be calculated by either (7-3) or (7-4). 

For the case that a root of the characteristic equation is unity in magnitude (e.g., p; = 140), 
(7-2) is constant in magnitude. Hence the natural response has a term that neither dies out nor 
becomes unbounded as k approaches infinity. If the natural response approaches a bounded non- 
zero steady state, the system is said to be marginally stable. Hence, for a marginally stable 
system, the characteristic equation (7-3) has at least one zero on the unit circle, with no zeros 
outside the unit circle. 

In the development above it was assumed that the poles of the system transfer function are 
distinct (no repeated poles). It can be shown that the same condition for stability applies if the 
transfer function has repeated poles (see Problem 7.2-1). 

We have demonstrated previously that for certain discrete-time control systems, transfer 
functions cannot be derived. A method for finding the characteristic equation for control systems 
of this type will now be developed. To illustrate this method, consider the system of Fig. 7-2(a). 
This system was considered in Example 5.3, and the output expression developed there is 


é = | 2+G|° [c+ sar) 
© =|3F g] pa 24G, |© 
F (z) 
2+G 


Hence that part of the denominator of C(z) that is independent of the input R is 


1+ | 2% | 
2+G,|% 


and this function set equal to zero is then the characteristic equation. 
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FIGURE 7-2 Discrete-time system. 


This characteristic function can be developed by a different procedure. Since the stability 
of a linear system is independent of the input, we set R(s) = O in the system. In addition, we 
open the system in front of a sampler and derive a transfer function at this open. We open at a 
sampler, since we can always write a transfer function if an input signal is sampled prior to being 
applied to a continuous-time part of a system. If we opened the system at any other point, we 
would not be able to find a transfer function. We denote the input signal at this open as E,(s), and 
the output signal as E,(s). Thus, for the system of Fig. 7-2(a), the system flow graph with no sys- 
tem input and an open at the sampler appears as shown in Fig. 7-2(b). By Mason’s gain formula 
(or any other applicable technique), we write 


—G Gy 
E,(s) = -—\™ pt 
o(S) I+ G *(8) 


Taking the z-transform of this equation, we obtain 


GG) 
2+G, 


Ez) = -| loro 


We will denote this open-loop transfer function as 


Ez) _ -| GG | 
Eo |2+G]® 


Gop(Z) = 


7.2 Stability 
For the closed-loop system, E,(z) = E,(z), and the foregoing equations yield 
[1 — Gop(Z)JE,(z) = 0 
Since we can set initial conditions on the system such that E,(z) # 0, then 
1— Gy (z) = 0 


and this relationship must be the system characteristic equation. Hence the characteristic equa- 


tion for this system is 
1+ | 172 lo (0) 
26 Gz 


which checks the results of Example 5.3. Another example will now be given. 


EXAMPLE 7.1 


Consider the system of Example 5.2, which is repeated in Fig. 7-3(a). The flow graph of the 
system is opened at the first sampler as shown in Fig. 7-3(b). The effect of the second sampler is 
included, by denoting its input as E£;(s) and its output as EX(s). 

From this flow graph we write 


E, = G\E; — G,HE;} 
E, = —GE} 
Starring the first equation and solving for E I, we obtain 
e. CTET 
1+ G,H* 


1s 


C(s) 


(a) 


1 Es) Ets) E\(s) E\(s) 


FIGURE 7-3 System for Example 7.1. 
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Starring the second equation and substituting in the value for E | we obtain 
eo TSG G ey 
ere ear 
1 + G,H* 
Since E,(z) = E,(z) in the closed-loop system, 


i OG = 
1 + G, H(z) 


Thus we can write the characteristic equation 
1 + G,(z)G(z) + GoH(z) = 0 


This result is verified in Example 5.2. We leave the derivation of the characteristic equation by 
opening the system at the second sampler as an exercise for the reader (see Problem 7.2-2). 


From the discussion above, in general, the characteristic equation of a discrete system can 
be expressed as 


1+ FQ) =1-G,(2 = 0 (7-5) 


where G,,(z) is the open-loop transfer function. The function F(z) is important in analysis and 
design, and we will call it the open-loop function. For the system of Fig. 7-1, the open-loop func- 
tion is GH(z) and the open-loop transfer function is —-GH(z). 

The characteristic equation of an LTI discrete system can also be calculated from a 
state-variable approach. Suppose that the state-variable model of the system of Fig. 7-1 is 


x(k + 1) = Ax(k) + Br(k) 
y(k) = Cx(k) + Dr(k) 


where the output is now denoted as y(k) rather than c(k). By taking the z-transform of these state 
equations and eliminating x(z), it was shown in Chapter 2 [see (2-84)] that the system transfer 
function is given by 

Y(z) 


EME _ ay 
RO C[zI — AJ B +D 


The denominator of the transfer function is seen to be |zI — A |, and thus the characteristic 


equation for the system is given by 
zI- A| = 0 (7-6) 


7.3 BILINEAR TRANSFORMATION 


Many analysis and design techniques for continuous-time LTI systems, such as the Routh- 
Hurwitz criterion and Bode techniques, are based on the property that in the s-plane the stability 
boundary is the imaginary axis. Thus these techniques cannot be applied to LTI discrete-time 


7.3 Bilinear Transformation 


systems in the z-plane since the stability boundary is the unit circle. However, through the use of 
the transformation 


1 + (T/2)w 
z= 1+ (T/2w (7-7) 
1 — (T/2)w 
or solving for w, 
2z-1 
w= i (7-8) 
Tz+1 


the unit circle of the z-plane transforms into the imaginary axis of the w-plane. This can be seen 
through the following development. On the unit circle in the z-plane, z = e/°7 and 


2z-1 QelT— 1 2 gieT/? — g-jeT/?2 2 T 
Z = = = jptan (7-9) 


Tzt+1 z=e T ~ T eT + 1 — T gj2T/2 + g72T/2 


Thus it is seen that the unit circle of the z-plane transforms into the imaginary axis of the 
w-plane. The mappings of the primary strip of the s-plane into both the z-plane (z = e°”) and 
the w-plane are shown in Fig. 7-4. It is noted that the stable region of the w-plane is the left 
half-plane. 

Let jw,, be the imaginary part of w. We will refer to w,, as the w-plane frequency. Then 
(7-9) can be expressed as 


Wy = z tan — (7-10) 


and this expression gives the relationship between frequencies in the s-plane and frequencies in 
the w-plane. 

For small values of real frequency (s-plane frequency) such that wT is small, (7-10) 
becomes 


2 wT 2 (wT 
WO, = pian = ( ) =w (7-11) 


Thus the w-plane frequency is approximately equal to the s-plane frequency for this case. The 
approximation is valid for those values of frequency for which tan (wT/2) = wT/2. For 


oF 
2 


< 


u Ke ae (7-12) 
10 10T 10 

the error in this approximation is less than 4 percent. Because of the phase lag introduced by 
the zero-order hold, we usually choose the sample period T such that (7-12) is satisfied over 
most if not all of the band of frequencies that the system will pass (the system bandwidth). At 
w = o,/10, the zero-order hold introduces a phase lag of 18° (see Fig. 3-13), which is an appre- 
ciable amount and, as we shall see, can greatly affect system stability. 
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ay 


FIGURE 7-4 Mapping from s-plane to z-plane to w-plane. 


7.4 THE ROUTH-HURWITZ CRITERION 


The Routh—Hurwitz criterion [1] may be used in the analysis of LTI continuous-time systems to 
determine if any roots of a given equation are in the right half of the s-plane. If this criterion is 
applied to the characteristic equation of an LTI discrete-time system when expressed as a func- 
tion of z, no useful information on stability is obtained. However, if the characteristic equation is 
expressed as a function of the bilinear transform variable w, then the stability of the system may 
be determined by directly applying the Routh—Hurwitz criterion. 

We assume that the reader is familiar with the procedures for applying the Routh—Hurwitz 
criterion. The procedure is summarized in Table 7-1. The technique will now be illustrated via 
examples. 


7.4 The Routh—Hurwitz Criterion 


TABLE 7-1 Basic Procedure for Applying the Routh-Hurwitz Criterion 


1. Given a characteristic equation of the form 


Fw) = bw” + byw" | + +++ + bw + bo = 0 


form the Routh array as 


w” b, Dy—2 bn—4 
w” : by-1 bn-3 by—s 
wr? cy Co C3 

: dı dy d3 
w! Ji 

w? kı 


2. Only the first two rows of the array are obtained from the characteristic equation. The remaining 
rows are calculated as follows. 


é by—1Pn—2 — Dn bn—3 d= C13 — Dn=1C2 

= {= — 

by- cy 

a= ba—-1bn-4 — Pn bn—s A= Cibn-5 — bn-163 

í b,- i Cy 
ba—1bn-6 — bnbn-7 

G= 


Dy-1 


3. Once the array has been formed, the Routh—Hurwitz criterion states that the number of roots of 
the characteristic equation with positive real parts is equal to the number of sign changes of the 
coefficients in the first column of the array. 


4. Suppose that the w’? th row contains only zeros, and that the w ‘th row above it has the coefficients 
Qj, Q,... . The auxiliary equation is then 


awi + aw? + agwt + s+ = 0 


This equation is a factor of the characteristic equation. 


EXAMPLE 7.2 


Consider the system of Example 6.7 shown in Fig. 7-5, with T = 0.1 s. With K = 1, the 
open-loop function is 


s(s + 1) 


FIGURE 7-5 System for Examples 7.2 and 7.3. 
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Hence, from the z-transform tables we obtain 
z- 1I[E€7+T- D+- e” ez 
z e- De-e” 


G(z) = 


_ 0.00484z + 0.00468 
(z — 1)( — 0.905) 


Then G(w) is given by 
Gw) = G@)|=p4cr2w/1-C/201 = CE) l=0+0.05w/0-0.05w) 
or 


—0.0000420w? — 0.0491w + 1 
w? + 0.997w 


G(w) = 


The bilinear transform can also be computed using MATLAB: 


>> T=0.1; numz=[0.00484 0.00468]; denz=[1 -1.905 0.905]; 

Gz=tf (numz,denz,T) ; 

Gw=d2c(Gz,'tustin') %Bilinear transform from discrete to continuous; d2c 
returns a function of s, but is w in our notation here 


Gw = 
-4.199e-05 s*2 - 0.04913 s + 0.9995 


s*2 + 0.9974 s + 4.429e-15 


Then the characteristic equation for any value of K is given by 
1 + KG(w) = (1 — 0.000042K)w? + (0.997 — 0.0491K)w + K = 0 


The Routh array derived from this equation is 


w? 1 — 0.000042K 3.81K = K< 23,800 
w! 0.997 — 0.491K => K< 203 
w? K => K>0 


Hence, for no sign changes to occur in the first column, it is necessary that K be in the range 
0 < K < 20.3, and this is the range of K for stability. 


EXAMPLE 7.3 


Consider again the system of Example 6.4 (shown again in Fig. 7-5 with T = 1 s) with a gain 
factor K added to the plant. This bilinear transform can be computed using MATLAB: 


>> T=1; numz=[0.368 0.264]; denz=[1 -1.368 0.368]; 
Gz=tf (numz,denz,T) 
Gw=d2c(Gz,'tustin') %Bilinear transform; change s to w. 


7.5 Jury’s Stability Test 


Gw = 
-0.03801 s*2 - 0.386 s + 0.924 


s*2 + 0.924 s - 2.052e-16 
Then the characteristic equation is given by 
1 + KG(w) = (1 — 0.03801K )w* + (0.0924 — 0.386K)w + 0.924K = 0 


The Routh array derived from this equation is 


w? 1 — 0.03801 K 0.924K => K< 263 
w! 0.924 — 0.386 K => K<239 
w? 0.924 K => K>0 


Hence the system is stable for 0 < K < 2.39. 


From our knowledge of continuous-time systems, we know that the Routh—Hurwitz cri- 
terion can be used to determine the value of K at which the root locus crosses into the right 
half-plane (i.e., the value of K at which the system becomes unstable). That value of K is the gain 
at which the system is marginally stable, and thus can also be used to determine the resultant 
frequency of steady-state oscillation. Therefore, K = 2.39 in Example 7.3 is the gain for which 
the system is marginally stable. 

In a manner similar to that employed in continuous-time systems, the frequency of oscilla- 
tion at K = 2.39 can be found from the w? row of the array. Recalling that œ, is the imaginary 
part of w, we obtain the auxiliary equation (see Table 7-1) 


(1 — 0.03801K )w* + 0.924K| x5 39 = 0.9092w? + 2.2084 = 0 


2.2084 
= j.) = +j1.5585 
“= “IN 0.9092 7 


Then w, = 1.5585 and from (7-10), 
2 f 2 | asao] 
= — tan 


or 


w = — tan 


T 5 = 1.324 rad/s 


and is the s-plane (real) frequency at which this system will oscillate with K = 2.39. 

The same system was used in both examples in this section, but with different sample 
periods. For T = 0.1 s, the system is stable for 0 < K < 20.3. For T = 1 s, the system is stable 
for 0< K< 2.39. Hence we can see the dependency of system stability on the sample period. 
The degradation of stability with increasing T (decreasing sampling frequency) is due to the 
delay (phase lag) introduced by the sampler and data hold, which is illustrated in the frequency 
response of the data hold, shown in Fig. 3-13. 


7.5 JURY'S STABILITY TEST 


For continuous-time systems, the Routh—Hurwitz criterion offers a simple and convenient technique 
for determining the stability of low-ordered systems. However, since the stability boundary in the 
z-plane is different from that in the s-plane, the Routh—Hurwitz criterion cannot be directly applied 
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to discrete-time systems if the system characteristic equation is expressed as a function of z. A sta- 
bility criterion for discrete-time systems that is similar to the Routh—Hurwitz criterion and can be 
applied to the characteristic equation written as a function of z is the Jury stability test [2]. 

Jury’s test will now be presented. Let the characteristic equation of a discrete-time system 
be expressed as 


Q(z) = Anz” + ap- T! +--+ tayz + a = 0, a, > 0 (7-13) 


Then form the array as shown in Table 7-2. Note that the elements of each of the even-numbered 
rows are the elements of the preceding row in reverse order. The elements of the odd-numbered 
rows are defined as 


pi a0 Qn-k = bo Dy—1-k 
k > Ck = 

dn ák Dy-1 bk (7 14) 
d, = Co Cn-2-k 

Cn-2 Ck 


The necessary and sufficient conditions for the polynomial Q(z) to have no roots outside or on 
the unit circle, with a, > 0, are as follows: 


Q) > 0 
CoC 1> 0 
|ao| < a, 
[bol > [bail (7-15) 
leol > [c-2] 
[do| > |d,-s| 


[m| > |m] 


TABLE 7-2 Array for Jury's Stability Test 


= a n 
z? z! 2 ZE zn k eed z” 1 z 
do ay ay haw An-k TP aAn-| ay 
an an-ı an-2 ak ay a 
bo bi by Dyk byi 

Dat by-2 Dy-3 bk- bo 

Co Cc} C2 Cn—k 

Cn-2 Cn-3 Cn—4 Ck-2 

lo hy h b 

b bh Lı lo 


mo mı m 
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Note that for a second-order system, the array contains only one row. For each additional order, 
two additional rows are added to the array. Note also that for an nth-order system, there are a 
total of n + 1 constraints. 

Jury’s test may be applied in the following manner: 


1. Check the three conditions Q(1) > 0, (—1)"Q(—1) > 0, and |aọ| < a,, which requires 
no calculations. Stop if any of these conditions are not satisfied. 

2. Construct the array, checking the conditions of (7-15) as each row is calculated. Stop if 
any condition is not satisfied. 


EXAMPLE 7.4 


Consider again the system of Example 6.4 (and Example 7.3). Suppose that a gain factor K is 
added to the plant, and it is desired to determine the range of K for which the system is stable. 
Now, from Example 6.4, the system characteristic equation is 


(0.368z + 0.264)K 
z? — 1.368z + 0.368 


1+ KG(z)= 1+ 


or 
2 + (0.368K — 1.368)z + (0.368 + 0.264K) = 0 


The Jury array is 


rad Zz ra 


0.368 + 0.264K 0.368K — 1.368 1 


The constraint Q(1) > 0 yields 
1 + (0.368K — 1.368) + (0.368 + 0.264K) = 0.632K > 0=K > 0 
The constraint (— 1)? Q(—1) > 0 yields 


2.736 _ 


1 — 0.368K + 1.368 + 0.368 + 0.264K > OS K < 0104 > 26.3 
The constraint |aọ| < ap yields 
0.368 + 0.264K < 1>K < ee e 2.39 
f ` 0.264 ` 


Thus the system is stable for 


0< K< 2.39 
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The system is marginally stable for K = 2.39. For this value of K, the characteristic equation is 
z? + (0.368K — 1.368)z + (0.368 + 0.264K)|g-239 = z? — 0.4882 + 1 = 0 
The roots of this equation are 


z = 0.244 + j0.970 = 12(£75.9°) = 12( 41.32 rad) = 12( 407) 


Since T = 1s, the system will oscillate at a frequency of 1.32 rad/s. These results verify those 
of Example 7.3. 


EXAMPLE 7.5 


Suppose that the characteristic equation for a closed-loop discrete-time system is given by the 
expression 


Q(z) = z — 1.82" + 1.05z — 0.20 = 0 
The first conditions of Jury’s test are 


Q1) = 1 — 1.8 + 1.05 — 0.2 = 0.05 > 0 
(10-1) = -[-1 — 1.8 — 1.05 — 0.2] = 4.05 > 0 
| ao | = 02 < az = 1 


The Jury array is calculated to be 


Zz z! z z 
—0.2 1.05 -1.8 1 

1 -1.8 1.05 —0.2 
—0.96 1.59 —0.69 


where the last row has been calculated as follows: 


—0.2 1 —0.2 -1.8 
= = —0. b, = = 1. 
bo | 1 Be api | 1 i 3 
—0.2 1.05 
b, = = -0. 
á | 1 -18 | me 
Hence the last condition is 


7.5 Jury’s Stability Test 


Therefore, since all conditions are satisfied, the system is stable. The characteristic equation can 
be factored as 


Q(z) = (z — 0.5) (z — 0.8) 


This form of the equation clearly indicates the system’s stability. 


EXAMPLE 7.6 


In this example we wish to determine the range of values of Kp in Example 6.8 so that the sys- 
tem is stable. Recall that in Example 6.8, a proportional-plus-integral (PI) compensator was 
designed to satisfy certain steady-state constraints. In this example we derive the requirements 
for this compensated system to be stable. The characteristic equation for the system is given by 
the expression 


1+ D(ZGz) = 0 


Or, from Example 6.8, 


i (Kı + Kp)z — “ll: = a =i) 


ESA z-e! 
Thus 
Z= [0 +e- 0 -eK + Kpl +e” — (1 -eK = 0 


Suppose that T = 0.1 s and K; = 100T = 10, as required in Example 6.8. Then the characteris- 
tic equation becomes 


z? — (0.953 — 0.0952Kp)z + 0.905 — 0.0952Kp = 0 
For this system, the Jury array is 


z? z! z 


0.905 — 0.0952Kp 0.0952Kp — 0.953 1 


The constraint Q(1) > 0 yields 
1 + 0.0952Kp — 0.953 + 0.905 — 0.0952Kp > 0 
Thus this constraint is satisfied independent of Kp. The constraint (— 1)? Q(-1) > 0 yields 


1 — 0.0952Kp + 0.953 + 0.905 — 0.0952Kp > 0 
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or since Kp is normally positive, 
0 < Kp < 15.01 
The constraint |a)| < a yields 
|0.905 — 0.0952Kp| < 1 
or 
Kp < 20.0 


Thus the stability constraint on positive Kp is Kp < 15.01, in order that the steady-state error 
constraint in Example 6.8 be satisfied. 


7.6 ROOT LOCUS 
For the LTI sampled-data system of Fig. 7-6, 


Co) _ KGR) 
R(z) 1 + KGH) 


The system characteristic equation is, then, 
1 + KGH(z) = 0 (7-16) 


The root locus for this system is a plot of the locus of roots in (7-16) in the z-plane as a function 
of K. Thus the rules of root-locus construction for discrete-time systems are identical to those for 
continuous-time systems, since the roots of any equation are dependent only on the coefficients of 
the equation and are independent of the designation of the variable. Since the rules for root-locus 
construction are numerous and appear in any standard text for continuous-time control systems 
[1, 4], only the most important rules will be repeated here in abbreviated form. These rules are 
given in Table 7-3. 

Although the rules for the construction of both s-plane and z-plane root loci are the same, 
there are important differences in the interpretation of the root loci. For example, in the z-plane, 
the stable region is the interior of the unit circle. In addition, root locations in the z-plane have 
different meanings from those in the s-plane from the standpoint of the system time response, as 
was seen in Fig. 6-11. 


Ris) C(s) 
G(s) = 


y 
~ 
y 


H(s) 


À 


FIGURE 7-6 Sampled-data system. 


7.6 Root Locus 


TABLE 7-3 Rules for Root-Locus Construction 
For the characteristic equation 
1 + KGH(z) = 0 


1. Loci originate on poles of GH(z) and terminate on the zeros of GH(z). 


2. The root locus on the real axis always lies in a section of the real axis to the left of an odd number of poles 
and zeros on the real axis. 


3. The root locus is symmetrical with respect to the real axis. 


4, The number of asymptotes is equal to the number of poles of GH(z), n,, minus the number of zeros of 
GH(2), n,, with angles given by (2k + 1)m/ m, — n). 


5. The asymptotes intersect the real axis at o, where 


5 poles of GH(z) — 5 zeros of GH(z) 
i 


Ny — Ny 

6. The breakaway points are given by the roots of 

AGHO _ 5 
dz 
or, equivalently, 
d(num d(den = num 

O (num(z)) AG) (den(z)) _ 0, GHO -= (2) 
dz dz den(z) 


The two examples that follow review not only the root-locus technique, but also the part it 
plays in stability analyses. 


EXAMPLE 7.7 


Consider again the system of Example 6.4. For this system 


0.368K(z + 0.717) 
(z — 1)(z — 0.368) 


KGK) = 


Thus the loci originate atz = 1 and z = 0.368, and terminate atz = —0.717 and z = ©. There 
is one asymptote, at 180°. The breakaway points, obtained from 


d — 
z GW = 0 


occur at z = 0.65 for K = 0.196, and z = —2.08 for K = 15.0. The root locus is then as shown 
in Fig. 7-7. 

The points of intersection of the root loci with the unit circle may be found by graphical 
construction, the Jury stability test, or the Routh—Hurwitz criterion. To illustrate the use of the 
Jury stability test, consider the results of Example 7.4. The value of gain for marginal stability 
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FIGURE 7-7 Root locus for Example 7.7. 


(i.e., for the roots to appear on the unit circle) is K = 2.39. For this value of gain, the character- 
istic equation is, from Example 7.4, 


z — 0.4882 +1=0 


The roots of this equation are 
z = 0.244 + j0.970 = 12(+75.8°) = 12( +£1.32 rad) = 1Z (wT) 


and thus these are the points at which the root locus crosses the unit circle. Note that the fre- 
quency of oscillation for this case is œ = 1.32 rad/s, since T = 1s. This was also calculated in 
Example 7.3 using the Routh—Hurwitz criterion, and in Example 7.4 using the Jury test. 

The value of the gain at points where the root locus crosses the unit circle can also be 
determined using the root-locus condition that at any point along the locus the magnitude of the 
open-loop function must be equal to 1 [i.e., | KGH(z)| = 1]. Using the condition and Fig. 7-8, 
we note that 


0.368K(Z,) __ 
(P\)(P) 
From Fig. 7-8 the following values can be calculated: Z} = 1.364, P, = 1.229, and P, = 0.978. 


Using these values in the equation above yields K = 2.39. AMATLAB program that solves for 
and plots a root locus for this example is given by 


>> T= 1; 
num = [0 0.368 0.264]; 
den = [1 -1.368 0.368]; 


Gz = tf£(num,den,T) ; 
rlocus (Gz) 
axis([-3 2 -2 2]) %Set to match Figure 7-7 


Note that the breakaway points and their respective gains K can be found directly from the 
MATLAB rlocus plot, as can the gain and locations of the roots as they cross the unit circle. 


7.6 Root Locus 


Point at which the root 
locus crosses the unit 
circle 


x 


Unit circle 


FIGURE 7-8 Determination of the system gain at the crossover point on the unit circle. 


EXAMPLE 7.8 


Consider the system shown in Fig. 7-9. The transfer function [1 + 10s] is that of an analog pro- 
portional-plus-derivative (PD) controller [1]. The digital PD controller is covered in Chapter 8. 
We wish to determine the form of the root locus and the range of K for stability. 

We denote the open-loop function as 


KG(s) = 3 


1 —e "| K(1L + 10s) 
s 
Applying the z-transform, we obtain 


10.5K(z — 0.9048) 
-17 


KG(z) = 


R + —e-Ts 
„| ie" >| 1+10s AES 


wa 


FIGURE 7-9 System for Example 7.8. 
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-__ Unit circle 


3 Double pole 
atz=1 


I 
I 
ni , << = 
\ 
\ 
Point A k 
\ 
Me Zero at 
NG z= 0.9048 
FIGURE 7-10 Root locus for the system of Example 7.8. 
The loci originate atz = 1 and terminate at z = 0.9048 and z = —. There is one asymptote at 


180°. The root locus is shown in Fig. 7-10. 


The system becomes unstable when the closed-loop pole leaves the interior of the unit 
circle at point A shown in Fig. 7-10. The value of K at this point can be determined from the 


condition KG(z) = —1. Therefore, 


10.5K(z — 0.9048) 
z- 17 z=-1 


_ 10.5K(—1.9048) 


4 


Thus K = 0.2, and we see that the system is stable for 0 < K < 0.2. 
Consider the following MATLAB program that generates Fig. 7-10. The breakaway points 
and gain limit for stability can be verified directly from the MATLAB-generated root-locus plot. 


Gs t£([10 1]; [1 0 0]); 
Gz c2d(Gs,T); % 


rlocus (Gz) 
axis([-1.5 1.5 -1.25 1.25]) 


So Ts I7 


7.7 THE NYQUIST CRITERION 


c2d includes the zero-order hold 


To develop the Nyquist criterion for discrete-time systems, we consider the two systems shown 
in Fig. 7-11. In Fig. 7-11(b), G(s) contains the transfer function of a data hold. The transfer func- 


tion for the continuous-time system of Fig. 7-11(a) is 


C(s) G,(s) 
= (7-17) 
R(s) 1 + G,(s)H(s) 
and for the sampled-data system of Fig. 7-11(b) the transfer function is 
c* G* 
(s)_ GG) nae 
R*(s) 1 + GH*(s) 


7.7 The Nyquist Criterion 


R(s) + C(s) R(s) + C(s) 
\ G,(s) > \ 7 G(s) 


y 


H(s) |< H(s) 
(a) (b) 
FIGURE 7-11 Continuous-time and sampled-data systems. 
Thus the characteristic equation for the continuous-time system is 
1 + G,(s)H(s) = 0 (7-19) 
and for the sampled-data system, the characteristic equation is 
1 + GH*(s) = 0 (7-20) 


The characteristic equation of the sampled-data system can also be written as 
1 + GH(z) = 0 (7-21) 


Recall that the continuous-time system is stable if the roots of (7-19) are all contained in the left 
half-plane. Similarly, the sampled-data system is stable if the roots of (7-20) all lie in the left 
half-plane, or if the roots of (7-21) all lie within the unit circle. 

The Nyquist criterion is based on Cauchy’s principle of argument [5]. 


THEOREM. Let f(z) be the ratio of two polynomials in z. Let the closed curve C in the z-plane 
be mapped into the complex plane through the mapping fz). If f(z) is analytic within and on C, 
except at a finite number of poles, and if f(z) has neither poles nor zeros on C, then 


N=Z-—P 


where Z is the number of zeros of f(z) in C, P is the number of poles of f(z) in C, and N is the 
number of encirclements of the origin, taken in the same sense as C. 


S-PLANE NYQUIST DIAGRAM. In order to determine the stability of an analog system via the 
Nyquist criterion, a complex-plane plot of the open-loop function, G,(s)H(s), is made. This plot 
is referred to as the Nyquist diagram. The closed curve of C in Cauchy’s principle of argument is 
called the Nyquist path, and for continuous-time systems encloses the right half-plane as shown 
in Fig. 7-12. 

The Nyquist criterion states that if the complex-plane plot of G,(s)H(s), for values of s on 
the Nyquist path, is made, then 


N=Z-P > Z=N+P (7-22) 


where N is the number of clockwise encirclements of the — 1 point made by the plot of G,(s)H(s), 
Z is the number of zeros of the characteristic equation enclosed by the Nyquist path, and P is the 
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joa 
s 
A 
R — œ 
yy o 
A 


FIGURE 7-12 Nyquist path in the s-plane. 


number of poles of the open-loop function enclosed by the Nyquist path. Since the Nyquist path 
encloses the right half-plane, Z in (7-22) must be zero for stability. 


EXAMPLE 7.9 


As an example of the Nyquist criterion applied to a continuous-time system, consider the system 
of Fig. 7-13. The Nyquist path and the resultant Nyquist diagram are shown in Fig. 7-14. The 
small detour taken by the Nyquist path around the origin, labeled I on Fig. 7-14(a), is necessary, 
since G,(s) has a pole at the origin. Along this detour, let 


s = pe”, p< 1 
Then 
K K 
G,(s)|s = pe” A pe? = oo 0) 


Thus the small detour generates the large arc on the Nyquist diagram. For the Nyquist path along 
the jw-axis (II), 


K K 


jo + jo) wV1 + o 


This portion of the Nyquist diagram is simply the frequency response of the system. Along the 
large arc of the Nyquist path, G,(s) ~ 0. The complete Nyquist diagram is given in Fig. 7-14b. 
Now let us apply the Nyquist criterion. We can see from the Nyquist diagram in Fig. 7-14 


‘ 55 
| > 
s(s+ 1) 


FIGURE 7-13 System for Example 7.9. 


Z (90° — tan™ tw) 


G,(s) l; = pe” a 


7.7 The Nyquist Criterion 


= 
= | 
= 


(a) (b) 
FIGURE 7-14 Nyquist diagram for Example 7.9. 


that N = 0. Since the open-loop transfer function has no poles in the right half-plane, P = 0, 
and therefore from the equation Z = N + P we find that Z = 0. Thus the system is stable. 
In addition, from the Nyquist diagram in Fig. 7-14 it can be seen that the system is stable for all 
K>0. 


Consider now the sampled-data system of Fig. 7-11(b). The characteristic equation is 
given in (7-20), and thus the Nyquist diagram for the system may be generated by using the 
s-plane Nyquist path of Fig. 7-12 (i.e., the same path as that used for continuous-time systems). 
However, recall from Chapter 3 that GH*(s) is periodic in s with period jw,. Thus it is neces- 
sary only that GH*(jw) be plotted for —w,/2 =< w = w,/2, in order to obtain the frequency 
response. Consider also the relationship, from (3-11), 


GH*(jo) = = >) GH(jo + jno,) 


oe le 


(7-23) 


plGHGe) + GH(jo + jw) + GH(jw + j20,) +] 


Since physical systems are generally low pass, GH*(jw) may be approximated by only a few 
terms of (7-23). In general, however, the approximation will not apply for w > w,/2. A digital 
computer program may be written for (7-23), and thus the Nyquist diagram of a sampled-data 
system may be obtained without calculating the z-transform of the transfer function. 


z-PLANE NYQUIST DIAGRAM. The Nyquist diagram may also be generated directly from the 
z-plane. The Nyquist path for the z-plane is the unit circle, and the path direction is counter- 
clockwise, as shown in Fig. 7-15. To apply Cauchy’s principle of argument, let Z; and P; be the 
zeros of the characteristic equation and the poles of the open-loop function, respectively, inside 
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FIGURE 7-15 Nyquist path in the z-plane. 


the unit circle; and let Z, and P, be the zeros of the characteristic equation and the poles of the 
open-loop function, respectively, outside the unit circle. Then, from (7-22), 


N = —(@; — P) (7-24) 


where N is the number of the clockwise encirclements of the —1 point made by the Nyquist 
diagram of GH(z). The minus sign appears in (7-24) since the Nyquist path is counterclockwise. 
Now, in general, the order of the numerator and the order of the denominator of 1 + GH(z) are 
the same. Let this order be n. Then 


Z,+Z,=n (7-25) 
P,+P=n (7-26) 


Solving (7-25) and (7-26) for Z; and P, respectively, and substituting the results in (7-24), we 
obtain 


N=Z,-P, (7-27) 


Thus the Nyquist criterion is given by (7-27), with the Nyquist path shown in Fig. 7-15. The 
Nyquist diagram for the system of Fig. 7-11(b) is obtained by plotting GH(z) for values of z on 
the unit circle. The subscripts in (7-27) are usually omitted; then 


N=Z-P => Z=N+P (7-28) 


where N= number of clockwise encirclements of the —1 point 
Z = number of zeros of the characteristic equation outside the unit circle 


P = number of poles of the open-loop function, or equivalently poles of the 
characteristic equation, that are outside the unit circle 


7.7 The Nyquist Criterion 


EXAMPLE 7.10 


The Nyquist criterion will now be illustrated using the system of Fig. 7-16. From Example 6.4, 


0.368z + 0.264 
(z — 1) — 0.368) 


G(z) = 


The Nyquist path and the Nyquist diagram are both shown in Fig. 7-17. The detour around the 
z = 1 point on the Nyquist path (Fig. 7-17(a)) is necessary since G(z) has a pole at this point. 
On this detour, 


z=1+ peř, p< 1 
and 


0.632 1 
z=Itpe” * —z(-9) 


oo) pe”(0.632) P 


Thus this detour generates the large arc on the Nyquist diagram (Fig. 7-17(b)). For z on the unit 
circle, 


0.368% T + 0.264 
(eT — 1)(e/°T — 0.368) 


G(z) 


z= et 


In this equation w varies from —@,/2 to w,/2. Since G(e!”’) for 0 > w > —o,/2 is the complex 
conjugate of G(e/””) for 0 < w < w,/2,itisnecessary tocalculate G(e/”’) only for0 < w < w,/2. 


This calculation results in the frequency response for G(z). Note that G(—1) = —0.0381. 
Rs) + lets K Ci) 
S T=1s s s(s +1) 


FIGURE 7-16 System for Example 7.10. 
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Unit circle 


(a) (b) 
FIGURE 7-17 Nyquist path and Nyquist diagram for Example 7.10. 
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The calculation of the Nyquist diagram for the portion of the diagram labeled II in 
Fig. 7-17(b) may be accomplished in several ways. We may use 


G*(s) ls = jw or G(z) |. Sgor 


as the basis for calculation. Generally, computer calculations are required to evaluate the fre- 
quency response. A MATLAB program to plot the Nyquist diagram of Fig. 7-17(b) follows. 


>> T= 1; 
num = [0 0.368 0.264]; 
den = [1 -1.368 0.368]; 


Gz = tf(num,den,T) ; 
nyquist (Gz) 
axis([-1.2 0.2 -0.7 0.7]) 


Note that the point at which the curve crosses the real axis (—0.0381 and —0.418) can be deter- 
mined directly from the MATLAB Nyquist plot. 

We see from Fig. 7-17 that N = 0, since the Nyquist diagram does not encircle the — 1 point. 
In addition, P = 0 since G(z) has no poles outside the Nyquist path. Hence Z = (N + P) = 0, 
and the system is stable. 

Suppose that a gain K is added to the plant. The system can be forced into instability by 
increasing this gain K by a factor of 1/0.418, or 2.39. However, the same system without sampling, 
as shown in Example 7.9, is stable for all positive values of gain K. As stated earlier, the destabiliz- 
ing effect of the sampling can be seen from the phase lag introduced by the sampler and data hold. 


As an additional point in Example 7.10, the analog system model is stable for all positive values 
of plant gain K. This does not carry over to the physical system that is being modeled. The second-order 
model will be accurate only over limited signal levels. A large increase in gain within the loop will 
result in large signals, and in general, the linear second-order model will no longer be accurate. 


EXAMPLE 7.11 


Consider again the system of Example 7.10. For this system 


0.3682 + 0.264 
z? — 1.3682 + 0.368 


G(z) = 


Then G(w) is given by, from Example 7.3, 


—0.0381w* — 0.386w + 0.924 
w? + 0.924w 


G(w) = 


The Nyquist diagram can be obtained from this equation by allowing w to assume values from 
JO to jæ. Since G(w) has a pole at the origin, the Nyquist path must detour around this point. 
The Nyquist diagram generated by MATLAB program below for this G(w) is, within numerical 
accuracy, the same as the one generated using G(z) as shown in Fig. 7-17. 


>> num = [-0.0381 -0.368 0.924]; 
den = [1 0.924 0]; 

nyquist (num, den) 

axis([-1.2 0.2 -0.7 0.7]) 


7.7 The Nyquist Criterion 


TABLE 7-4 Functions for Calculating the Nyquist Diagram 


Open-loop function Range of variable 
GH*(s) s = jo, 0S os o,/2 
GH(z) zg=e*', 0O£ eT <7 
GH*(w) w = jop, 0S opo 


Three different transfer functions may be used to generate the Nyquist diagram: GH*(s), 
GH(z), and GH(w). Of course, the Nyquist diagrams generated will be identical in each case. 
Table 7-4 gives the functions and the range of variables required for the calculation of the 
Nyquist diagram. The range of variables gives only the upper half of the Nyquist path. If a pole 
of the open-loop function occurs in the range of the variable, a detour must be made around 
the point that the pole occurs. 


GAIN AND PHASE MARGINS. For a stable continuous-time system, the gain margin is defined 
as the factor by which the gain must change to force the system to marginal stability. The phase 
margin is defined as the angle through which the Nyquist diagram must be rotated such that the 
diagram intersects the —1 point. The gain and phase margin definitions for stable discrete-time 
systems are exactly the same; that is, in the Nyquist diagram shown in Fig. 7-18, the gain margin 
is 1/a, and the phase margin is b, 


PULSE TRANSFER FUNCTIONS. At this point a discussion of certain properties of pulse trans- 
fer functions is in order. For the system of Fig. 7-19(a), 


C(z) = G(Z)E(z) 


FIGURE 7-18 Nyquist diagram illustrating stability margins. 
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FIGURE 7-19 Discrete unit pulse response. 


where we can express G(z) as 


m m-1 
G(2) = om ere = — m (7-29) 
By dividing the denominator of G(z) into its numerator, we can express G(z) as 
G(z) = gin — mz" + gn -— mt 1) 707D 4 (7-30) 
The discrete unit impulse function is defined by the transform 
E(z) = 1 (7-31) 


Thus the discrete unit impulse function is a number sequence {e(k)} that has a value of unity for 
k = 0, and a value of zero fork = 1,2,3, ... . Hence, if in Fig. 7-19, E(z) is the unit impulse 
function, then 


CR) = GREE) = GR) (7-32) 


Thus (7-30) is the system impulse response. 

Fig. 7-19(b) shows e(t) for the case that E(z) is the unit impulse function. For most physi- 
cal systems we would expect a response c(t) as shown in the figure. The plant does not respond 
instantaneously to the input, but it will have responded to some nonzero value at t = T. Hence 
we may express C(z) as 


CR) = AD! + ez? + o (7-33) 
Comparing (7-33) with (7-30), we see that, in general, 
n-m=1 (7-34) 


Then, for a physical system, we generally expect the order of the numerator of its pulse transfer 
function to be one less than the order of the denominator. If the plant can respond instantaneously, 
the order of the numerator will be equal to the order of the denominator. If the order of the numera- 
tor is greater than the order of the denominator, the plant will respond prior to the application of the 
input. This case, of course, is not physically realizable; the plant is said to be noncausal. 
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7.8 THE BODE DIAGRAM 


The convenience of frequency-response plots for continuous-time systems in the form of 
the Bode diagram in both analysis and design stems from the straight-line approximations 
that are made, and these straight-line approximations are based on the independent variable, 
jw, being imaginary [1, 2]. Thus Bode diagrams of discrete-time systems may be plotted, using 
straight-line approximations, provided that the w-plane form of the transfer function is used. For 
convenience, a summary of the first-order terms used in the construction of a Bode diagram is 
given in Table 7-5 and Fig. 7-20. Since terms with complex zeros or poles are not amenable to 
straight-line approximations, these terms have been omitted. 
Let us now employ the Bode diagram in the analysis of a familiar example. 


EXAMPLE 7.12 


Consider again the system of Example 7.3. For this system, 


0.0381(w — 2)(w + 12.14) 
w(w + 0.924) 


G(w) = 


and 
0.0381(jw,, — 2)(jw,, + 12.14) 
JO (Oy + 0.924) 


G(joy) = 


Note that the numerator break frequencies are w,, = 2 and w„ = 12.14 and the denomina- 
tor break frequencies are w,, = 0 and w,, = 0.924. The Bode diagram for this system, using 
straight-line approximations, is shown in Fig. 7-21. Both the gain and phase margins of the sys- 
tem are shown on the diagram. 

As stated in Example 7-10, this system can be made unstable by increasing the gain. This 
can also be seen in Fig. 7-21. Increasing the gain is equivalent to shifting the entire magnitude 
curve vertically upward. Therefore, if the gain is increased by an amount equal to the gain mar- 
gin, a condition of marginal stability will exist. A MATLAB program that plots the Bode dia- 
gram for this example is given by 


>>num = [-0.0381 -0.386 0.924]; 
den = i 0.924 0]; 

Gw = tf(num,den) ; 

eae w), grid 


The Bode aaa can also be plotted from G(z) using MATLAB. 


>> G(s) for this example is given in Figure 6-2 

num = [1]; den = [1 1 0]; Gs = tf£(num,den); T=1; 

Gz=c2d(Gs,T); *Assumes a zero-order hold 

margin (Gz j smargin generates a Bode plot with the gain and phase margins 
denoted. 
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TABLE 7-5 Summary of Terms Employed in a Bode Diagram 


1. A constant term K. When this term is present, the log magnitude plot is shifted up or down by the 
amount 20 log)9K. 

2. The term jo, or 1/jw,,. If the term jw, is present, the log magnitude is 20 log9w,,, which is a straight 
line with a slope of +20 dB/decade, and the phase is constant at +90°. If the term 1/jw,„ is present, the 
log magnitude is —20 log w,,, which is a straight line with a slope of —20 dB/decade, and the phase is 
constant at —90°. The Bode plots for these terms are shown in Fig. 7-20. 

3. Theterm(1 + jo,t)or[1/(1 + jw,7)].Theterm(1 + jw,,t)hasalogmagnitude of 20 logio V1 + w27? 
which can be approximated as 20 logjg! = 0 when w,,7 << 1 and as 20 logjqw,,t, when œt >> 1. 


The corner or “break” frequency is w,, = 1/r. The phase is given by the expression tan” 'w, 7. The 
term [1/(1 + jw,,7)] is handled in a similar manner. The Bode plots for these functions are shown in 
Fig. 7-20. 
ry 
~ +20 dB/decade PN 
m m 
2 2 —20 dB/decade 
Q oO 
ae} © 
B E 
2 2 
2 0 > 2 0 > 
= log Oy = 1 log Owy 
A 4 
90° 90° — 
2 A 
S 0- š 0H 
a a 
—90° — —90° 
(a) (b) 
4 4 
aa) m 
Zz 2 l 
2 ; 2 il 
az i +20 dB/decade E m 
h=] = I T 
= 0 “ = 0 
2 i; log ,, 2 log w, 
f —20 dB/decade 
i i 
1 A 
90° = 
1 
2 a i 
E E 
a a 
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(c) (d) 
FIGURE 7-20 Short summary of terms employed in Bode diagrams: (a) Bode plot for jww; (b) Bode 
plot for 1/jwy; (c) Bode plot for 1 + jwt; (d) Bode plot for 1/(1 + jwr). 
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FIGURE 7-21 Bode diagram for Example 7.12. 


The gain margin for this system is 7.58 dB at 1.32 rad/s; phase margin, 30.4° at 0.772 rad/s. 


GAIN-PHASE PLOTS The gain-phase plot of the frequency response of a system is a plot of 
the same information shown by a Bode diagram, plotted on different axes. For the gain—phase 
plot, the frequency response is plotted as gain versus phase on rectangular axes, with frequency 
as a parameter. Thus the frequency response of a discrete-time system may be plotted on gain- 
phase axes, as well as on a Bode diagram. As an example, the gain—phase plot of the system of 
Example 7.12 is shown in Fig. 7-22. This plot is called a Nichols chart and is covered in more 
detail later in this chapter. 


7.9 INTERPRETATION OF THE FREQUENCY RESPONSE 


Throughout this chapter the term frequency response has been used in relation to discrete-time 
systems. The physical meaning of a system frequency response in relation to continuous-time 
systems is well known. In this section the physical meaning of the frequency response of a 
discrete-time system is developed. 
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dBA 


20 = 
G(jo,,) 


—360° —270° —180° 


FIGURE 7-22 Gain-phase plot for Example 7.12. 


Consider a discrete-time system described by 
C(z) = G(z)E(z) 


and suppose that the system input is a sampled sine wave; that is, 


z sin wT 
(z = EPT pn e27) 


E(z) = {sin wf] = 


Then 


G(z)z sin wT — kz kaz 


C - - = - 
@) (z= ez -eh z— eh z- 


Phase 


Jol + C) 


(7-35) 


where C,(z) are those components of C(z) that originate in the poles of G(z). If the system 
is stable, these components of c(nT) will tend to zero with increasing time, and the system 


steady-state response is given by 


Now, from (7-35), 
_ G(e/") sin wT _ Gel") 
gT _ jo ~~ 2j 


Expressing G(e*®7) as 
Ge!) = | Ge!) | e” 


(7-36) 


7.10 Closed-Loop Frequency Response 


we see that (7-36) becomes 


_ (Ge) |e” 


kı zj (7-37) 
Since k, is the complex conjugate of k4, then 
[GEA] _ -|e 
JN F = : (7-38) 
2(-j) 2j 
Thus, from (7-36), (7-37), and (7-38), 
Co (kT) = kie + kaeT 
gp d@kT+0) _ glokT +0) 
= |GE] 7 
2j 
= |G(e/?)| sin (wkT + 0) (7-39) 


From the development above it is seen that if the input to a stable discrete-time system 
is a sinusoid of frequency w, the steady-state system response is also sinusoidal at the same 
frequency. The amplitude of the response is equal to the amplitude of the input multiplied 
by | G(e/°")|, and the phase of the response is equal to the phase of the input plus the angle 
of G(e/"). Thus it is seen that G(e*#7) is the true system frequency response at the sampling 
instants. 


7.10 CLOSED-LOOP FREQUENCY RESPONSE 


In this chapter many of the techniques presented for closed-loop stability analysis are based 
on the system open-loop frequency response. Of course, the system transfer characteristics are 
determined by the closed-loop frequency response. In this section the closed-loop frequency 
response of a control system is related graphically to its open-loop frequency response. The 
resultant graph is important conceptually, especially in the design of control systems; this graph 
is useful in illustrating the meaning of gain and phase margins as relative-stability parameters. 
However, if we want to calculate the closed-loop frequency response, we do not use graphical 
techniques; instead, we use computer software. 
Consider the discrete-time system shown in Fig. 7-23(a). For this system, 


Cw) _ eo 
RZ) 1+ GQ) 


The closed-loop frequency response is given by 


C(e} = G#5 
REPI 1 + G) 


(7-40) 
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(a) 
FIGURE 7-23 Determining closed-loop frequency response from open-loop frequency response. 


Suppose that G(e/’) is as shown in the polar plot in Fig. 7-23(b). Then the numerator and 
the denominator of (7-40) are the vectors shown for the frequency w = w4, and the frequency 
response at w; is the ratio of these vectors. Let the ratio of these vectors be denoted as 


G(ei#7) | g0 l l 
|Ge")| = Mei®-8) = Mel? (7-41) 


CeT) B 
|1 + G |e 


Re") 


CONSTANT M CIRCLES. The locus of points in the G(e/”) plane for which the magnitude of the 

closed-loop frequency response, M, is a constant is called a constant magnitude locus, or a con- 

stant M circle. To see that these loci are in fact circles, consider the following development. Let 
Gel’) = X + jY (7-42) 


Then, from (7-40) and. (7-41), 
y XF 
a+X +Y 


Hence 
X7(1 — M’) — 2M?X — M? + (1 — MAY =0 (7-43) 
For M # 1, wecan express this relationship as 
Lx + | a (7-44) 
M - 1 (M? — 1% 


This relationship is the equation of a circle of radius |M/(M? — 1)| with center at 
X = -M?’(M? — 1) and Y = 0. For M = 1, (7-43) yields X = —4, which is a straight line. 


Fig. 7-24 illustrates the constant M circles. 
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Gel?) 


FIGURE 7-24 Constant magnitude circles. 


CONSTANT N CIRCLES. The loci of points of constant phase are also circles. It is seen from 


(7-41) and (7-42) that 
i r) ( Y ) 
b= 0-8 = tan (z — tan i 


Then, letting N = tan o, 


Y Y 
tanð — tan B X 1+X 
N = tan (0 — B) = = 
1 + tan OtanB ER] Y | 
XL1 +X 


Hence 


2 a 
X+X+Y -Y=0 
N 


This equation can then be expressed as 


(x+3) +C- aa) =at C) 
x+-) +(¥ =- + (7-45) 
2 2N) 4 \2N 
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b= 20° iy io 
G(e! ) 


FIGURE 7-25 Constant phase circles. 


This is the equation of a circle with radius of V 1/4 + (1/2N)* with center at X = —1/2 and 
Y = 1/(2N). Fig. 7-25 illustrates the constant N (phase) circles. Note that accuracy is very lim- 
ited in the region of the —1 point for Figs. 7-24 and 7-25. For this reason the Nichols chart is 
often used, instead of the constant M and N circles. The Nichols chart will now be discussed. 


NICHOLS CHART. The gain—phase plane was introduced in Section 7.8 and was shown to be 
useful in graphically presenting a system frequency response. For example, the open-loop fre- 
quency response G(e/7) presented as a polar plot in Fig. 7-23 could also be plotted in the gain- 
phase plane, as shown in Fig. 7-22. Also, the closed-loop constant M circles of Fig. 7-24 and the 
closed-loop constant N circles of Fig. 7-25 can be plotted in the gain—phase plane. Such a plot is 
called the Nichols chart [6], and is often used in relating the open-loop frequency response and 
the closed-loop frequency response. Fig. 7-26 illustrates the Nichols chart. 

The frequency response G(e/”") is usually computed via computer programs. Thus it is 
logical to add statements to these programs that will, at the same time, calculate the closed-loop 
frequency response, rather than using a graphical procedure as described above. The computer 
procedure is more accurate, saves time, and is not limited to the system of Fig. 7-23(a). However, 
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as stated above, the constant M and N circles and the Nichols chart are very useful in under- 
standing the effects on the closed-loop frequency response of varying the open-loop frequency 
response. An example will now be given that illustrates closed-loop frequency response. 


EXAMPLE 7.13 


Again the system of Example 6.4 will be considered. 
G(s) = ———~ 

O= G+) 
First, let’s compute the Nichols chart for this system using MATLAB. 


>> num = [1]; den = [1 1 0]; Gp = tf(num,den); T = 1; 
Gz=c2d(Gp,T); nichols (Gz), grid 


The resulting Nichols chart is plotted in Fig. 7-27. Note that the gain margin (7.6 dB) and phase 
margin (30°) are labeled on the plot. 

For this example, next we compare the closed-loop responses for T = 1 s and T = 0.1 s. 
The following MATLAB program computes both the closed-loop frequency and step responses. 


40 


30 


20 


-1 dB}, 


i [i3aB 


System: Gz 
Gain (dB): —0.013 
Phase (deg): —150 
Frequency (rad/s): 0.773 


Open-Loop Gain (dB) 


+ 7 7 — System: Gz 

ra i Gain (dB): —7.6 
on | Phase (deg): —180 

Frequency (rad/s): 1.33 


i a ane PE PEA PPPE TTET OTT T i 


—40 Hee pS : i : : : 
—36 =315 =270 =225 —180 —135 


Open-Loop Phase (deg) 


FIGURE 7-27 Nichols chart for Example 7.13. 


7.10 Closed-Loop Frequency Response 


>> num = [1]; den = [1 1 0]; Gp = tf(num,den); 

Tl = 1; Gzl=c2d(Gp,T1); [Gm1,Pm1] = margin (Gz1); 

Cz1 = feedback (Gz1,1); 

T2 = 0.1; Gz2 = c2d(Gp,T2); [Gm2,Pm2] = margin(Gz2) ; 
Cz2 = feedback (Gz2,1); 

%Plot the closed-loop frequency response 


figure(1), bode(Cz1,'--k',Cz2,'-k'), axis([0.25 2.5 -225 10]), grid 
%Plot the step response 
figure(2), step(Cz1,'--k',Cz2,'-k'), axis([0 20 0 1.5]), grid 


SList the step response and margin parameters 
StepTl=stepinfo(Cz1) ,Pm1,Gm1=20*1log10(Gm1)%Convert to dB 
StepT2=stepinfo(Cz2) ,Pm2,Gm2=20*1log10(Gm2)%Convert to dB 


The closed-loop frequency response calculated above is plotted in Fig. 7-28 and the step response 
in Fig. 7-29. Note that the frequency response for the T = 1 s case has a peak of 6.06 dB at 
0.87 rad/s; for T = 0.1 s, the peak is 1.56 dB at 0.74 rad/s. A more pronounced resonance in the 
closed-loop frequency response generally indicates more overshoot in the step response, as is 
readily apparent for these cases in Fig. 7-28. The peak overshoot for T = 1 s is 40 percent, and 
that for T = 0.1 s is 18 percent. 

A resonance in a closed-loop frequency response can also be correlated with the system sta- 
bility margins. For the system of Fig. 7-23(a), the denominator of the closed-loop transfer function 
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FIGURE 7-28 Closed-loop frequency response magnitudes for Example 7.13. 
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FIGURE 7-29 Step responses for Example 7.13. 


is the distance from the —1 point to the Nyquist diagram, as shown in Fig. 7-23(b). If the stability 
margins are small, the Nyquist diagram passes close to the —1 point, and the denominator of the 
closed-loop transfer function has a distinct minimum producing a closed-loop system resonance. For 
the systems of Example 7.13, the following MATLAB program generates the Nyquist diagrams: 

>> num = [1]; den = [1 1 0]; Gs = tf(num,den); 
Tl = 1; Gzl = c2d(Gs,T1) ; 
T2 = 0.1; Gz2 = c2d(Gs,T2); 
figure (1) ,nyquist (Gz1,Gz2), axis([-0.5 0.05 -0.5 0.5]), grid 
figure (2) ,nyquist (Gz1,Gz2), axis([-0.08 0.01 -0.08 0.08]), grid 


From these Nyquist diagrams, for T = 0.1 s, negative axis crossover point is —0.0488 so the 
gain margin is 20 log,9(1/0.0488) = 26.2 dB. For T = 1 s, negative axis crossover point is 
—0.418 making the gain 20 logj9(1/0.418) = 7.58 dB. These results match those found earlier 
in this chapter. Please note that the correlation between the closed-loop frequency response and 
the time response of a system is investigated in greater detail in Chapter 8. 


7.10 Closed-Loop Frequency Response 
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FIGURE 7-30 Nyquist diagrams for Example 7.13. (a) Larger scale to examine the T = 1 s case; 


(b) smaller scale to examine the T = 0.1 s case. 
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In summary, we see from both the constant M circles of Fig. 7-24 and the Nichols chart of 
Fig. 7-26 that a peaking in the closed-loop frequency response can occur only if the open-loop 
frequency response passes near the —1 point. Hence any control system that has a significant 
resonance also has small stability margins. Conversely, any system that has small stability mar- 
gins will exhibit a significant resonance in its time response. 


7.11 SUMMARY 


In this chapter a number of techniques for analyzing the stability of discrete-time systems have 
been presented. It has been shown that many of the methods used in the analysis of continuous-time 
systems are applicable to sampled-data systems also. The chapter contains a number of examples, 
and the use of the same system in many of the examples throughout the chapter provides a com- 
mon thread and basis for comparison among the various stability analysis techniques. Many of the 
analysis techniques presented in this chapter will be extended to design in Chapter 8. 
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Assume that for the system of Fig. 7-1, the system closed-loop transfer-function pole pı is repeated such 
that the system characteristic equation is given by 


C = PYR = Pr+ VE S Pra) ite ES Pa) = 9 


where r is an integer. Show that the requirement for system stability is that the magnitudes of all poles of 
the closed-loop transfer function are less than unity, that is, |p| < 1,i = 1,7 + 1,r+2,...,2. 

The system of Example 7.1 and Fig. 7-3 has two samplers. The system characteristic equation is derived in 
Example 7.1 as 


1 + GiG) + GH) = 0 


Show that the same characteristic equation is obtained by opening the system at the second sampler. 
(a) The unit-step response of a discrete system is the system response c(k) with the input r(k) = 1 for 
k = 0. Show that if the discrete system is stable, the unit-step response, c(k), approaches a constant as 


7.2-4. 


7.2-5. 
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k— œ. [Let T(z) be the closed-loop system transfer function. Assume that the poles of T(z) are distinct 
(no repeated poles). ] 

(b) Find the conditions on the closed-loop system transfer function T(z) such that the unit-step response 
approaches zero as k—> %. 

(c) The discrete unit-impulse response of a discrete system is the system response c(k) with the input 
r(k) = 1 fork = 0 and r(k) = 0 for k = 1. Show that if the discrete system is stable, the unit impulse 
response, c(k), approaches zero. [Let T(z) be the closed-loop system transfer function. Assume that the 
poles of T(z) are distinct (no repeated poles). ] 

Consider a sampled-data system with T = 0.5 s and the characteristic equation given by 


(z — 0.9)(z — 0.8)(<? — 1.92 + 1.0) = 0 


(a) Find the terms in the system natural response. 

(b) A discrete LTI system is stable, unstable, or marginally stable. Identify the type of stability for this system. 

(c) The natural response of this system contains an undamped sinusoidal response term of the form 
A cos(wkT + 6). Find the frequency w of this term. 

Consider the system of Fig. P7.2-5 with T = 1 s. Let the digital controller be a variable gain K such that 

D(z) = K. Hence m(kT) = Ke(kT). 

(a) Write the closed-loop system characteristic equation. 

(b) Determine the range of K for which the system is stable. 

(c) Suppose that K is set to the lower limit of the range in part (b) such that the system is marginally stable. 
Find the natural-response term that illustrates the marginal stability. 

(d) Repeat part (c) for the upper limit of the range of K. 


Rs) 4 E(s) toes | MO 
> D(z) >| — 
T= 15 sS stl 


C(s) 


FIGURE P7.2-5 System for Problem 7.2-5. 


7.2-6. 


7.3-1. 


7.5-1. 


Consider the system of Fig. P7.2-5, and let the digital controller be a variable gain K such that D(z) = K. 

Hence m(kT) = Ke(kT). 

(a) Write the closed-loop system characteristic equation as a function of the sample period T. 

(b) Determine the ranges of K > 0 for stability for the sample periods T = 1 s, T = 0.1 s,andT = 0.01 s. 

(c) Consider the system with all sampling removed and with G,(s) = K/(s + 1). Find the range of K > 0 
for which the analog system is stable. 

(d) Comparing the ranges of K from parts (b) and (c), give the effects on stability of reducing the sample 
period T. 

Consider the general bilinear transformation 


_l+aw 
1 — aw 


Z, 


where a is real and nonzero. 
(a) Show that this function transforms the stability boundary of the z-plane into the imaginary axis in the 
w-plane. 
(b) Find the relationship of frequency in the s-plane to frequency in the w-plane. 
(c) Find the stable region of the w-plane for a < 0 and for a > 0. 
Given below are the characteristic equations of certain discrete systems. 
@ 2 - 1iz+03=0 di) z — 2+ 0.25=0 
Gii) z7 — 012-03 = 0 (iv) z? — 0.25 = 0 
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(vy) 2-16z+1=0 (vi) z? — 2.02 + 0.99 = 0 
(vii) z? — 2.222 + 1.55z — 0.35 =0 (viii) z — 1.927 + 1.42 — 0.45 = 0 
(a) Use the Jury test to determine the stability of each of the systems. 
(b) List the natural-response terms for each of the systems. 
(c) For those systems in part (a) that are found to be either unstable or marginally stable, list the natural- 
response terms in part (b) that yield these results. 

7.5-2. Consider the system of Fig. P7.2-5 with T = 1 s. Let the digital controller be a variable gain K such that 
D(z) = K. Hence m(kT) = Ke(kT). 

(a) Write the closed-loop system characteristic equation. 

(b) Use the Routh—Hurwitz criterion to determine the range of K for stability. 

(c) Check the results of part (b) using the Jury test. 

(d) Determine the location of all roots of the characteristic equation in both the w-plane and the z-plane for 
the value of K > 0 for which the system is marginally stable. 

(e) Determine the s-plane frequency at which the system will oscillate when marginally stable, for K > 0. 

(f) Consider the system with all sampling removed and with G,(s) = K/(s + 1). Find the range of K for 
which the analog system is stable. 

(g) Comparing the ranges of K from parts (b) and (f), give the effects on stability of adding sampling to the 
analog system. 

7.5-3. Consider the temperature control system of Fig. P7.5-3. This system is described in Problem 1.6-1. For 
this problem, ignore the disturbance input, let T = 0.6 s, and let the digital controller be a variable gain 
K such that D(z) = K. Hence m(kT) = Ke(kT), where e(t) is the input to the sampler. It was shown in 
Problem 6.2-4 that 


Jie 2 _ 1.037 
ss +05) z= 0.7408 


(a) Write the closed-loop system characteristic equation. 

(b) Use the Routh-Hurwitz criterion to determine the range of K for stability. 
(c) Check the results of part (b) using the Jury test. 

(d) Let T = 0.06 s. Find the range of K for which the system is stable. 
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FIGURE P7.5-3 Chamber temperature control system. 


7.5-4. 


Problems 273 


(e) Comparing the ranges of K from parts (b) and (d), give the effects on stability of adding sampling to the 
analog system. 

Consider the robot arm joint control system of Fig. P7.5-4. This system is described in Problem 1.5-4. For 

this problem, T = 0.1 s and D(z) = 1. It was shown in Problem 6-7 that 


l-e™ 4 _ 0.01873z + 0.01752 
s s(s+2) (z — 1)(z — 0.8187) 


3 


(a) Write the closed-loop system characteristic equation. 

(b) Use the Routh-Hurwitz criterion to determine the range of K for stability. 

(c) Check the results of part (b) using the Jury test. 

(d) Determine the location of all roots of the characteristic equation in both the w-plane and the z-plane for 
the value of K > 0 for which the system is marginally stable. 

(e) Determine both the s-plane frequency and the w-plane frequency at which the system will oscillate 
when marginally stable, using the results of part (d). 

(£) Show that the frequencies in part (e) satisfy (7-10). 
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FIGURE P7.5-4 Robot arm joint control system. 


7.5-5. 


Consider the antenna control system of Fig. P7.5-5. This system is described in Problem 1.5-1. For this 
problem, T = 0.05 s and D(z) = 1. It was shown in Problem 5.3-15 that 


l-e™ 20 _ 0.02268z + 0.02052 
s s(s + 6) (z — 1)(z — 0.7408) 


3 


(a) Write the closed-loop system characteristic equation. 

(b) Use the Routh—Hurwitz criterion to determine the range of K for stability. 

(c) Check the results of part (b) using the Jury test. 

(d) Determine the location of all roots of the characteristic equation in both the w-plane and the z-plane for 
the value of K > 0 for which the system is marginally stable. 

(e) Determine both the s-plane frequency and the w-plane frequency at which the system will oscillate 
when marginally stable, using the results of part (d). 

(f) Show that the frequencies in part (e) satisfy (7-10). 
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FIGURE P7.5-5 Block diagram for an antenna control system. 


7.5-6. Consider the satellite control system of Fig. P7.5-6. This system is described in Problem 1.4-1. For this 
problem, T = 0.1 s, J = 0.1, H, = 0.02, and D(z) = 1. From the z-transform table, 


$ =e | _ 0.05(z + 1) 
5 2 (z = 1) 


S S 


(a) Write the closed-loop system characteristic equation. 
(b) Use the Routh-Hurwitz criterion to show that the system is unstable for all K. 
(c) Check the results of part (b) using the Jury test. 
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FIGURE P7.5-6 Block diagram for a satellite control system. 


7.5-7. For the system of Fig. P7.5-7, T = 2 s and 


K(z + 0.8 
CO = (z ) 


(z — 1) — 0.6) 


(a) Determine the range of K for stability using the Routh—Hurwitz criterion. 

(b) Determine the range of K for stability using the Jury test. 

(c) Show that the upper limit of K for stability in part (a) yields a marginally stable system. 
(d) Show that the upper limit of K for stability in part (b) yields a marginally stable system. 
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FIGURE P7.5-7 System for Problem 7.5-7. 


7.6-1. 


7.6-2. 


7.6-3. 


7.6-4. 


7.7-1. 


Problems 


For the system of Problem 7.2-5 and Fig. P7.2-5: 

(a) Plot the z-plane root locus. 

(b) Plot the w-plane root locus. 

(c) Determine the range of K for stability using the results of part (a). 
(d) Determine the range of K for stability using the results of part (b). 
For the chamber temperature control system of Problem 7.5-3 and Fig. P7.5-3: 
(a) Plot the z-plane root locus. 

(b) Plot the w-plane root locus. 

(c) Determine the range of K for stability using the results of part (a). 
(d) Determine the range of K for stability using the results of part (b). 
For the robot arm joint control system of Problem 7.5-4 and Fig. P7.5-4: 
(a) Plot the z-plane root locus. 

(b) Plot the w-plane root locus. 

(c) Determine the range of K for stability using the results of part (a). 
(d) Determine the range of K for stability using the results of part (b). 
For the satellite control system of Problem 7.5-6 and Fig. P7.5-6: 

(a) Plot the z-plane root locus. 

(b) Plot the w-plane root locus. 

(c) Determine the range of K for stability using the results of part (a). 
(d) Determine the range of K for stability using the results of part (b). 
For the robot arm joint control system of Problem 7.5-4 and Fig. P7.5-4, let K = 1. 
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(a) The frequency response for G(z) was calculated by computer and is given in Table P7.7-1. Sketch the 


Nyquist diagram for the open-loop function G(z)H;, with H, = 0.07 = —23.1 dB. 
(b) Determine the stability of the system. 


(c) If the system is stable, determine the gain and phase margins. If the system is unstable, find the value 


of K that gives a phase margin of 45°. 


(d) From the Nyquist diagram, determine the value of K > 0 for which the system is marginally stable. 
(e) Use the frequency response to find the frequency w at which the marginally stable system will oscillate. 


TABLE P7.7-1 Frequency Response for Problem 7.7-1 


Oy wo |G(jo) | |G(je,,)| ap LGU) 
0.1 0.100 19.97513 26.00 —93.14 
0.2 0.200 9.95054 19.95 —96.28 
0.3 0.300 6.59317 16.38 —99.38 
0.4 0.399 4.90325 13.80 —102.45 
0.5 0.499 3.88102 1177 —105.46 
0.6 0.599 3.19331 10.08 —108.41 
0.7 0.699 2.69741 8.61 —111.28 
0.8 0.799 2.32198 7.31 —114.08 
0.9 0.899 2.02741 6.13 —116.78 
1.0 0.999 1.78990 5.05 —119.40 
2.0 1.993 0.70945 —2.98 —140.61 
3.0 2.977 0.37308 —8.56 —154.64 
4.0 3.947 0.22743 —12.86 —164.43 


5.0 4.899 0.15270 —16.32 —171.82 
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TABLE P7.7-1 continued 


Oy o |G(jw,)| |G(je,)| ap LG) 
6.0 5.829 0.10973 —19.19 —177.74 
7.0 6.733 0.08291 —21.62 —182.72 
8.0 7.610 0.06511 —23.72 —187.04 
9.0 8.457 0.05270 —25.56 —190.88 

10.0 9.273 0.04372 —27.18 —194.33 

20.0 15.708 0.01403 —37.05 —217.40 

30.0 19.656 0.00798 —41.96 —229.64 

40.0 22.143 0.00558 —45.07 —236.77 


7.7-2. For the antenna control system of Problem 7.5-5 and Fig. P7.5-5, let K = 1. 

(a) The frequency response for G(z) was calculated by computer and is given in Table P7.7-2. Sketch the 
Nyquist diagram for the open-loop function G(z)H;,, with H, = 0.04 = —7.96 dB. 

(b) Determine the stability of the system. 

(c) If the system is stable, determine the gain and phase margins. If the system is unstable, find the value 
of K that gives a phase margin of 45°. 

(d) From the Nyquist diagram, determine the value of K > 0 for which the system is marginally stable. 

(e) Find the frequency w at which the marginally stable system will oscillate. 


TABLE P7.7-2 Frequency Response for Problem 7.7-2 


Ow o [Go| [Gola ZFVw) 

0.1 0.100 33.32874 30.4564 —91.09 
0.2 0.200 16.65748 24.4321 —92.19 
0.3 0.300 11.09735 20.9042 —93.29 
0.4 0.400 8.31502 18.3970 —94.38 
0.5 0.500 6.64381 16.4479 —95.47 
0.6 0.600 5.52819 14.8510 —96.56 
0.7 0.699 4.73007 13.4965 —97.65 
0.8 0.799 4.13040 12.3187 —98.73 
0.9 0.899 3.66305 11.2754 —99.81 
1.0 0.999 3.28834 10.3377 —100.89 
2.0 1.998 1.58193 3.9759 —111.28 
3.0 2.994 0.99511 —0.0619 —120.81 
4.0 3.986 0.69524 —3.1949 —129.31 
5.0 4.974 0.51456 —5.8345 —136.78 
6.0 5.955 0.39576 —8.1482 —143.31 


7.0 6.929 0.31327 —10.2199 —149.03 
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TABLE P7.7-2 continued 


Wy o |G(jo,) | [Gola 40G) 
8.0 7.895 0.25375 —12.0995 —154.07 
9.0 8.852 0.20951 —13.8203 —158.54 
10.0 9.799 0.17582 —15.4069 —162.54 
20.0 18.546 0.05320 —26.7969 —188.55 
30.0 25.740 0.02706 —34.2817 —203.49 
40.0 31.416 0.01738 —40.4880 —213.67 


7.7-3. For the satellite control system of Problem 7.5-6, the frequency response for G(z) was calculated by com- 
puter and is given in Table P7.7-3. 
(a) Sketch the Nyquist diagram for the open-loop function G(z)H, with H = 0.02 = —34.0 dB. 
(b) Use the results in part (a) to determine the range of K for stability. 


TABLE P7.7-3 Frequency Response for Problem 7.7-3 


Ow o [Go| [GGl 46G) 
0.1 0.100 1000.01200 60.00 —180.28 
0.2 0.200 250.01250 47.95 —180.57 
0.3 0.300 111.12360 40.91 —180.85 
0.4 0.399 62.51249 35.91 —181.14 
0.5 0.499 40.01249 32.04 —181.43 
0.6 0.599 27.719027 28.87 —181.71 
0.7 0.699 20.42065 26.20 —182.00 
0.8 0.799 15.63749 23.88 —182.29 
0.9 0.899 12.35817 21.83 —182.57 
1.0 0.999 10.01249 20.01 —182.86 
2.0 1.993 2.51247 8.00 —185.71 
3.0 2.977 1.12354 1.01 —188.53 
4.0 3.947 0.63738  —3.91 —191.30 
5.0 4.899 0.41231  —7.69 —194.03 
6.0 5.829 0.29001 —10.75 —196.69 
7.0 6.733 0.21622 —13.30 —199.29 
8.0 7.610 0.16829 —15.47 —201.80 
9.0 8.457 0.13538 —17.36 —204.22 
10.0 9.273 0.11180 —19.03 —206.56 
20.0 15.708 0.03536 —29.03 —225.00 
30.0 19.656 0.02003 —33.96 —236.30 


40.0 22.143 0.01398 —37.09 —243.43 
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7.8-1. For the antenna control system of Problem 7.5-5 and Fig. P7.5-5: 
(a) Plot the z-plane root locus. 
(b) Plot the w-plane root locus. 
(c) Determine the range of K for stability using the results of part (a). 
(d) Determine the range of K for stability using the results of part (b). 
7.8-2. For the system of Problem 7.2-5 and Fig. P7.2-5, let K = 1. 
(a) Determine the stability of the system. 
(b) Sketch the Bode diagram, and use this diagram to sketch the Nyquist diagram. 
(c) If the system is stable, determine the gain and phase margins. If the system is unstable, find the value 
of K that gives a phase margin of 45°. 
(d) From the Nyquist diagram, determine the value of K > 0 for which the system is marginally stable. 
(e) Find the frequency w at which the marginally stable system will oscillate. 
7.8-3. For the temperature control system of Problem 7.5-3 and Fig. P7.5-3, let K = 1. 
(a) Determine the stability of the system. 
(b) Plot the Bode diagram, and the Nyquist diagram. 
(c) If the system is stable, determine the gain and phase margins. If the system is unstable, find the value 
of K that gives a phase margin of 45°. 
(d) From the Nyquist diagram, determine the value of K > 0 for which the system is marginally stable. 
(e) Find the frequency w at which the marginally stable system will oscillate. 

7.9-1. Given the pulse transfer function G(z) of a plant. For w = 2 rad/s, G(e/”7) is equal to the complex num- 
ber 1.32(—25°). The signal 5 cos 2¢ is applied to the input (sampler and data hold) of the plant. Find the 
steady-state sampled output. 

7.10-1. For each case below, plot the Nichols chart and closed-loop frequency response. If the system is stable find 
the gain margin, phase margin, peak closed-loop frequency response, and system bandwidth. 
(a) The system of Problem 7.2-5 with K = 1. 
(b) The temperature control system of Problem 7.5-3 with K = 
(c) The robot arm joint control system of Problem 7.5-4 with K 
(d) The antenna control system of Problem 7.5-5 with K = 1. 
(e) The satellite control system of Problem 7.5-6 with K = 0.5. 
(f) The system of Problem 7.5-7 with K = 0.5. 

7.10-2. For the antenna control system of Problem 7.5-5, use MATLAB to: 
(a) Find the range of stability for K (by rlocus). 
(b) Find the gain K for critical damping (by rlocus). 
(c) Find the gain and phase margins at critical damping (by rlocus). 
(d) Find the step response parameters rise time, settling time, and percent overshoot (by stepinfo). 
(e) Find the frequency response peak and bandwidth. 
(f) Graphically display the root locus, Bode plot, Nyquist diagram, Nichols chart, step response, and 

closed-loop frequency response. 


1. 
= 0.5. 
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Digital Controller Design 


8.1 INTRODUCTION 


In the preceding chapters we have been concerned primarily with analysis. We have assumed that 
the control system was given, and we analyzed the system to determine stability, stability mar- 
gins, time response, frequency response, and so on. Some simple design problems were consid- 
ered: for example, the determination of gains required to meet steady-state error specifications. 

In this chapter we consider the total design problem: How do we design a digital control- 
ler transfer function (or difference equation) that will satisfy design specifications for a given 
control system? We will investigate the classical design techniques of frequency response and 
root locus. First, phase-lag and phase-lead controllers are considered. Then a particular type of 
lag-lead controller, called a proportional-plus-integral-plus-derivative (PID) controller, is devel- 
oped. Finally, design by root-locus procedures is introduced. Further design techniques, which 
are based on the state-variable model of the plant, are developed in Chapters 9 and 11. 

The preceding paragraph requires additional comment. All numerical design procedures 
are based on an inexact model of the physical system. Hence numerical design simply gets us to 
the point that we can experiment with the physical system, or with an accurate simulation that 
includes the system nonlinearities, time-varying components, and so on. Design is generally 
too complex if the accurate simulation model, sometimes called a truth model in optimal filter 
design, is used. Thus, in one sense, any type of numerical design procedure is trial and error, with 
the final form and coefficients of the controller determined by several iterations of first numeri- 
cal design, and then experimentation with either the physical system or an accurate simulation. 


8.2 CONTROL SYSTEM SPECIFICATIONS 


The design of a control system involves the changing of system parameters and/or the addi- 
tion of subsystems (called compensators) to achieve certain desired system characteristics. The 
desired characteristics, or performance specifications, generally relate to steady-state accuracy, 
transient response, relative stability, sensitivity to change in system parameters, and disturbance 
rejection. These performance specifications will now be discussed [1]. 
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Steady-State Accuracy 


Since steady-state accuracy was discussed in detail in Section 6.5, only a brief review will be 
given here. In Section 6.5, it was shown that steady-state accuracy is increased if poles atz = 1 
are added to the open-loop function, and/or if the open-loop gain is increased. However, added 
poles at z = 1 in the open-loop function introduce phase lag into the open-loop frequency 
response, resulting in reduced stability margins. Thus stability problems may ensue. In addi- 
tion, an increase in the open-loop gain generally results in stability problems, as was seen in 
Chapter 7. Thus a control system design is usually a trade-off between steady-state accuracy and 
acceptable relative stability (acceptable stability margins). 


Transient Response 


We define a physical system that has two dominant poles as one that can be modeled with rea- 
sonable accuracy by a second-order transfer function. Figure 8-1(a) illustrates a typical step 
response for a system that has two dominant complex poles. Typical performance criteria are 
rise time f,, peak overshoot M,, time-to-peak overshoot ¢,, and settling time f. Rise time in this 
figure is the time required for the response to rise from 10 percent to 90 percent of the final 


c(t) A 


M(dB) 4 


(b) 
FIGURE 8-1 System step response and bandwidth. 


8.2 Control System Specifications 


value. However, other definitions are also used for rise time, but all are similar. Settling time t, 
is defined as the time required for the response to settle to within a certain percent of the final 
value. Typical percentage values used are 2 percent and 5 percent. 

For a given system, the time response is uniquely related to the closed-loop frequency 
response. However, except for first- and second-order systems, the exact relationship is complex 
and is generally not used. As indicated in Section 7.10, a typical closed-loop frequency response 
is as shown in Figure 8-1(b), where only the magnitude is shown. In this figure, M, is the reso- 
nant peak value of the frequency response, and as was implied in Example 7.13, a larger resonant 
peak value indicates a larger peak overshoot M, in the step response. For example, a control-sys- 
tem specification sometimes used is to limit M, to 2 dB in order to limit M, to a reasonable value. 

Consider the standard second-order LTI analog system with the transfer function 


2 
On 


s + 2m, + w? 


T(s) = (8-1) 


which has the unit-step response [1] 
l tot 
cf) = 1—- ae “x sin (BwW,t + 8) 


where B = V1 — (and 0 = tan '(G/C). Shown in Fig. 8-2 are the relationships of the param- 
eters M,, M,, and t, of Fig. 8-1 to the damping ratio ¢ for this system. These plots are obtained 
from the equations [1] 


M, M, qt,)/77 


FIGURE 8-2 Characteristics of a second-order system. 
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M, = 1 + etVI-0 
1 
M, = ————— 
261 T= ie (8-2) 
Only 1 


The relationships apply only approximately to second-order complex poles of higher-order dis- 
crete systems (see Section 6.4). However, we see the importance of the damping ratio ¢ of com- 
plex poles. The fourth curve in Fig. 8-2 will be discussed in the next section. 

In the damped sinusoidal response term of the second-order system response c(t) just 
given, the time constant is seen to be T = 1/(Cw,,). This time constant determines the settling 
time 1, of Fig. 8-1(a). For example, for the response c(f) to settle to within 2 percent of the final 
value, 


e™/" = 0.02 


or t, = 3.97. Hence the system response settles out in approximately four time constants. 

The transient response is also related to the system bandwidth, shown as w, in Fig. 8-1(b). 
For a system, the product of rise time and bandwidth (i.e., the product t.w,) is approximately 
constant [1, 2]. Thus, to decrease rise time and increase the speed of response, it is necessary 
that the system bandwidth be increased. However, if significant high-frequency noise sources 
are present in the system, a larger bandwidth will increase the system response to these noise 
sources. In this case, a trade-off must be made between a fast rise time and an acceptable noise 
response. 


Relative Stability 


In Chapter 7 the relative stability measurements, gain margin and phase margin, were intro- 
duced. These margins are an approximate indication of the closeness of the Nyquist diagram 
(open-loop frequency response) to the —1 point. As was shown in Section 7.10, the closeness of 
the open-loop frequency response to the —1 point in the complex plane determines the resonant 
peak value M, of the closed-loop frequency response (see Fig. 8-1(b)). And M, is related, in an 
approximate sense, to the peak overshoot M, (Fig. 8-1) in the step response. Thus, in an approxi- 
mate sense, the stability margins are related to peak overshoot M,. Consider the closed-loop 
function of (8-1) for which the open-loop function G,(s) is given by 


oo? G,(s) 
=> T(s) = 


One) = Ge 4 ho.) 1+ G(s) 


For this system, the phase margin b, and the peak overshoot M, are directly related, as shown in 
Fig. 8-2. The curve plotted in Fig. 8-2 is the relationship [1] 


2% 
(VAT = 2g) 


Pn = tan! 
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This equation is often approximated by (see Problem 8.2-1) 
bm ~ 1006 


Sensitivity 


Generally, any control system will contain parameters that change with temperature, humid- 
ity, altitude, age, and so on. However, we prefer that the control system characteristics remain 
stable as these parameters vary. Of course, the system characteristics are a function of the system 
parameters, but in some cases the sensitivity of system characteristics to parameter variations 
can be reduced. A simple case will now be discussed. 

Consider the discrete system of Fig. 8-3(a). For this system the closed-loop transfer func- 
tion 7(z) is given by 


G(z) 


T(z) = 1+Go = 


Sensitivity to a parameter a is normally defined as a measure of the percentage change in T(z) to 
a percentage change in the parameter a. One such definition is 

Troa 
Aaja aT 


(8-3) 


sensitivity ~ 


where AT is the variation in T caused by Aa, the variation in parameter a. If the limit of (8-3) is 
taken as Aa — 0, we get the usual definition of sensitivity; that is, 


oT a 
ST = — — 8-4 
a= aT (8-4) 

+ 
G(z) 
(a) 
F(s) 
disturbance 
RG) 4 3 C(s) 
——} D(z) KR G(s) G(s) 
T + 


(b) 
FIGURE 8-3 Discrete control systems. 
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We will now find the sensitivity of T with respect to G for the system of Fig. 8-3(a). 


gz- G_1+00-00,  6@ 

T aG T EEG Go/+ Gel 
a 
1+ GQ 


At the frequency w, we let z = e/°7, and 


A 1 


oT Gert) a 


For this sensitivity to be small within the system bandwidth, we require that G(e/°’) >> 1. Thus 
we can reduce the sensitivity of T to G by increasing the open-loop gain. But as noted before, 
increasing the open-loop gain can cause stability problems. Thus, once again, in design we are 
faced with trade-offs. 

Consider now that G(z) is a function of the parameter a. Then we can express (8-4) as 


gee eae 


a aT dGoaT 


Thus 
r_ 1+ G@ -60 a aG(2) 
‘i [1+ G@P GV + G) ða 
(8-6) 
dG(z) 
a 
ða 


~ GOU + GOI 


Then, as in (8-5), to reduce the sensitivity we must increase the open-loop gain. 


Disturbance Rejection 


A control system will generally have inputs other than the one to be used to control the system 
output. An example is shown in Fig. 8-3(b). In this system F(s) is a disturbance. Since R(s) is the 
control input (or the reference input), we design the system such that c(t) is approximately equal 
to r(t). If F(s) is zero, then 


D(Z)G GZ) RO 
1 + D(2)GiG2) 


Cz) = 
Hence, in terms of the frequency response, we require that 
D(el?)G, Ge”) > 1 


over the desired system bandwidth. Then 


C(el?t) = RET 
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If we consider only the disturbance input in Fig. 8-3(b), then 


= FO 
1 + D(z)G,G,(z) 


Hence, over the desired system bandwidth, 


GF") 
DGG”) 


Cen) e 


Since the denominator of this expression is large, the disturbance response will be small, provided 
that the numerator is not large. Therefore, we generally have good disturbance rejection in a sys- 
tem provided that we have a high loop gain, and provided that the high loop gain does not occur in 
the direct path between the disturbance input and the system output [G.(s) in Fig. 8-3(b)]. 


Control Effort 


Another criterion that must be considered in the design of a control system is the control effort. For 
example, generally in a radar tracking system, an electric motor is used to rotate the radar antenna. 
Any physical motor will have a maximum torque that can be developed. If we call this control 
effort (the torque) u(t), then | u(t) | will be bounded. One procedure for including this constraint in 
the design of the system is to first design without considering the maximum torque available. Next 
the designed system is simulated under worst-case conditions to determine the maximum torque 
required. Then a physical motor is chosen that can produce this value of torque. This design proce- 
dure may be iterative, since the chosen motor may not have the model assumed in the initial design. 

Another example of constraints on control effort is the maximum energy that may be avail- 
able over a time period. This constraint is usually stated as 


ty 
| |u°(t)|dt = M 
0 


For example, certain types of attitude controllers for satellites have limited energy available. 
The topic of constraints on the control effort is covered in the design of certain types of optimal 
control systems in Chapter 11. 


8.3 COMPENSATION 


In this chapter we will, for the most part, limit the discussion to the design of compensators for 
single-input, single-output systems. A simple system of this type is shown in Fig. 8-4(a). For this 
system, 


C@) _ DOC) (8-7) 
R@) 1 + D(z)GH(z) 
and hence the characteristic equation is 
1 + D(z)GH(z) = 0 (8-8) 


We call compensation of the type shown in Fig. 8-4(a) cascade, or series, compensation. The 
effects of this compensation on system characteristics are given by the characteristic equation (8-8). 
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Digital 
compensator Plant 
R(s) + C(s) 
= D(z) -— >| Gis) 
= T 
Sensor 
H(s) j4 


R(s) F + 
G(s) 


Digital 


C(s) 
Gy (s) S, 
compensator 


FIGURE 8-4 Digital control systems. 


(b) 


It is sometimes more feasible to place the compensator within a loop internal to the system. 
Such a system is illustrated in Fig. 8-4(b). For this system, 


| G,G>R | 
Í| 1 + GIGA 
Cg) = GH (8-9) 
2412 
1 0 
1+ G,|G.A, 
The system characteristic equation is then 
1+ De 5| S| = 0 (8-10) 
Val TF CGH. 


This type of compensation is termed feedback, parallel, or minor-loop compensation. For this 
system, the effects of compensation on system characteristics are given by (8-10). 

In the following three sections, basically we will consider compensation by a first-order 
device. Thus the compensator transfer function can be expressed as 


D(z) = 7 1 (8-11) 


8.4 Phase-Lag Compensation 


The design of the compensator in these three sections will be performed in the frequency domain 
using Bode techniques; thus we will be working in the w-plane. The transformation of D(z) to 
the w-plane yields D(w); that is, 


DW) = D(2)| =n +c wy —CDwI1 (8-12) 


Thus D(w) is also first order, and we will assume it to be of the form 
1+ W/W wo 
Pa ae (8-13) 


BO = al + w/w 


wp 


where @,,9 is the zero location and w,,, is the pole location, in the w-plane. The dc gain of the 
compensator is found in (8-11) by letting z = 1, or in (8-13) by letting w = 0. Hence ap is the 
compensator dc gain. 

To realize the compensator, the transfer function must be expressed in z, as in (8-11). 
Then, from (7-8) and (8-13), 


pe aa E 
w0 OwplOwo T 2/T) 2/T + y0 
D(z) = a =a (8-14) 
pa WyO(Owp + 2/T) 2/T — owp 
gp 
Own | w=2/Nie—D/+DI 2/T + Ww 
Hence, in (8-11), 
Oy (09 + 2/T) 2 T — Wy 2/T — oy 
eg |) ere : > o (8-15) 


L@yo(@yp + 2/T) ~ T+ Oy S 2/T + yp 
The compensator of (8-13) is classified by the location of the zero, w,,9, relative to that of the 
pole, wp. If wo < @,p, the compensation is called phase lead. If wo > yp, the compensation 
is called phase lag. The phase-lag compensator will be discussed first. 


8.4 PHASE-LAG COMPENSATION 


In (8-13), for wo > yp», the frequency response of D(w) exhibits a negative phase angle, or 
phase lag. The frequency response of D(w), as given by a Bode plot, is shown in Fig. 8-5. The dc 
gain is do, and the high-frequency gain is 


a 
(high-frequency gain)gg = 20 log (8-16) 


wo 


The phase characteristic is also shown in Fig. 8-5. The maximum phase shift is denoted as by, 
and has a value between 0 and —90°, depending on the ratio @,,9/,,p. 

Design using phase-lag digital compensators will be discussed relative to the system of 
Fig. 8-6. For this system the characteristic equation is given by 


1 + D@Gz) = 0 (8-17) 
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dB 4 
20 log ag 


Phase 4 


wp Owm wo 


bu 


FIGURE 8-5 Phase-lag digital filter frequency-response characteristics. 


Digital Data 
filter hold Plant 
R(s) T j= es G(s) 

O = D(z) =| =| G,(s) 

= T s 
FIGURE 8-6 Digital control system. 
where 

= gT 
GQ) = J= oyo) (8-18) 


For a system configuration differing from that of Fig. 8-6, the characteristic equation is formed 
as in (8-17), and the frequency response of the transfer function that multiplies D(z), as in (8-17), 
is calculated. From that point, the design procedure follows that given below. 

As is seen from Fig. 8-5, phase-lag filters reduce the high-frequency gain relative to the 
low-frequency gain and introduce phase lag. Since, in general, phase lag tends to destabilize a 
system (rotates the Nyquist diagram toward the —1 point) the break frequencies, wwp and wwo, 
must be chosen such that the phase lag does not occur in the vicinity of the 180° crossover point 
of the plant frequency response G(ja,,), where 


_ —Ts 
Gw) = |== cyo) (8-19) 


z=[1+(T/2wI/[1—(T/2)w] 


for the system of Fig. 8-6. However, for stability purposes, it is necessary that the filter introduce 


the reduced gain in the vicinity of 180° crossover. Thus, both @,,, and wwo must be much smaller 


8.4 Phase-Lag Compensation 


than the 180° crossover frequency. Fig. 8-7 illustrates design by phase-lag compensation, where 
the compensator dc gain is unity. 

Note that in Fig. 8-7, both the system gain margin and the system phase margin o,, have 
been increased by the compensation, increasing relative stability. In addition, the low-frequency 
gain has not been reduced, and thus steady-state errors and low-frequency sensitivity have not 
been increased to attain the improved relative stability. The bandwidth has been decreased, 
which will generally result in a slower system time response. 

Suppose that in Fig. 8-7, we keep both ,,9 and the product dp w,,, constant, and increase do 
while decreasing w,,,. The high-frequency gain of the compensator remains constant, from (8-16). 
However, since we are increasing dp, the system open-loop low-frequency gain increases. Hence 
the closed-loop low-frequency gain approaches unity and the steady-state response is improved. 
However, for a given system, the increase in phase lag added to system phase characteristics may 
push the phase characteristic below the —180° line (see Fig. 8-7). Then we have a conditionally 
stable system, that is, one that can be forced to be unstable by reducing gain. If the system contains 
a saturation nonlinearity, large signals into this nonlinearity reduce its effective gain [1, 3]. Thus 
a phase-lag compensated system may exhibit instabilities for large signals (nonlinear operation). 

A technique for determining wp and ,,9 to yield a desired phase margin will now be given. 
It is assumed that the compensator dc gain, dg, is determined from the system specifications, and 
that the phase margin of ¢,, is desired. Refer to Fig. 8-7. The design steps are as follows: 


1. Determine the frequency, w,,,, at which the phase angle of G(jw,,) is approximately 
(—180° + ¢,, + 5°). The phase margin of the compensated system will occur at approxi- 
mately this frequency. 


dB 


1GGo,,) | 


1G(jo,) DGO) | 


(—_ Gain margin 
> 


/ GG oy) DG Ow) 


-180 ļ------------------f---}------ 


FIGURE 8-7 Design using phase-lag compensation. 
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2. Choose 
Ovo = 0.1e,1 (8-20) 


to ensure that little phase lag is introduced at w,,,. Actually, the compensator will introduce 
approximately 5° phase lag, which has been accounted for in step 1. 
3. At wp we want | D(jw,,,)G(j@,,;)| = 1. Since the gain of the compensator at high fre- 
QUENCIES is dpW,,,/M,9 (where ap is the compensator de gain), then 
AW AQ wp 1 
=] => = i 
OWo | Gj Wy) | 


P 


G jowi) 


w0 
(See Fig. 8-5.) Solving the last two equations for wp yields 


0.10, 
= eee ee (8-21) 


Ow : 
ao) Gje1)| 


The design is now complete, since the compensator dc gain, pole, and zero are known. 


Once ap, Wyp, and wwo are known, D(z) is obtained from (8-14). For the case that the sensor 
transfer function H(s) is not unity, replace G(j,,,) with GH(jow,,,) in step 1 and (8-21). 


EXAMPLE 8.1 


We will consider the design of a servomotor system as described in Section 1.5. Suppose that 
the servo is to control the horizontal (azimuth) angle for pointing a radar antenna. Then, in the 
closed-loop system of Fig. 8-6, c(t) is the azimuth angle of the antenna, and r(t) is the com- 
manded, or desired, azimuth angle. The plant transfer function derived in Section 1.5 is second 
order; however, we will assume that the armature inductance cannot be neglected, resulting in a 
third-order transfer function. Then suppose that the parameters of the plant are such that 


1 
s(s + 1)(0.5s + 1) 


G,(s) = 


Since the fastest time constant is 0.5 s, we will choose T to be one-tenth that value (a rule of 
thumb often used), or T = 0.05 s. Then 


Gu) z—1 | 1 | 
í 4! 2s + 1)(0.5s + 1) 


N 


=E —1.5 2 25] 
š > + + + 


Zz s? sS s+1 s+2 
Z= | 0.05z 1.5z 2z 0.5z | 
z Li-1% z-1 z2-0.9512 z -— 0.9048 


The frequency response of this system was calculated by computer and is given in Table 8-1 and 
plotted in Fig. 8-8. Suppose that it is desired to design a unity dc gain phase-lag compensator 
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TABLE 8-1 Frequency Response of the Plant in Example 8.1 


co) Oy |G(ei?) | |G(e”") | ap LGT) 
0.010 0.010 100.0 40.0 —90.9 
0.050 0.050 19.97 26.0 —94.4 
0.100 0.100 9.94 19.9 —98.7 
0.200 0.200 4.88 13.8 —107.3 
0.300 0.300 3.16 9.99 -115.6 
0.360 0.360 2.57 8.21 —120.5 
0.400 0.400 2.28 7.15 —123.7 
0.500 0.500 1.74 4.79 -131.3 
0.600 0.600 1.37 2.73 —138.5 
0.700 0.700 1.105 0.87 —145.3 
0.800 0.800 0.9064 —0.85 -151.6 
0.900 0.900 0.7533 —2.46 157.5 
1.000 1.000 0.6330 -3.97 —163.0 
1.200 1.200 0.4576 —6.79 -172.9 
1.370 1.371 0.3550 —8.99 —180.3 
1.500 1.501 0.2950 —10.6 -185.4 
2.000 2.001 0.1584 —16.0 201.4 
3.000 3.006 0.0590 —24.6 222.3 
5.000 5.026 0.0151 —36.7 244.3 


(ay = 1) to achieve a phase margin of 55°. Then, using the foregoing procedure, we see that 
the frequency wp; occurs where the phase of G(jo,,) is (—180° + 55° + 5°) = —120°, or 


ww = 0.36. At this frequency, | G(jw,,,)| ~ 2.57. Then, from (8-20), 


Wyo — 0.101 = 0.036 


and from (8-21), 


0.o 0.036 
wO = À = = 0.0140 
P o|G(ja,1)| 2.57) 


Then D(w) = (1 + w/0.036)/(1 + w/0.0140), and from (8-14), 


0.3890(z — 0.9982) _ 0.3890z — 0.3883 


D = 
@) (z — 0.993) z — 0.9993 


A MATLAB program to perform the calculations in this example is now given. 


>> Gp = tf([2], [1 3 2 0]); T = 0.05; a0 = 1; 
Gz = c2d(Gp,T); %Assumes a ZOH 
margin (Gz), grid 
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FIGURE 8-8 Frequency response for the system of Example 8.1. 


% Select wwl from the Bode plot 

% At wwl=0.360 and phase=-120deg 

wwl = 0.360; 

[magGjwwl1,phaseGwwl1] =bode(Gz,wwl); % The design point 
% Find D(z) 

wwO = 0.1*wwl; wwp = ww0/(a0*magGjww1) ; 

Kd = a0* (wwp* (ww0+2/T) ) / (wwO* (wwp+2/T) ); 

z0 = (2/T-ww0)/(2/T+ww0); zp = (2/T-wwp) /(2/T+wwp) ; 
Dz = Kd*tf([1 -z0],[1 -zp],T) % Display D(z) 

% Find the gain and phase margins of the compensated system 
DzGz=Dz*Gz; 

[Gm, Pm] = margin(DzGz); GmdB = 20*log10(Gm), Pm 


Calculation of the system open-loop frequency response shows that this compensator results in a 
gain margin of 16.8 dB and a phase margin of 55.9°. 


With phase-lag compensation, numerical problems may occur in the realization of the fil- 
ter coefficients. To illustrate this point, suppose that a microprocessor is used to implement the 
digital controller. Suppose, in addition, that filter coefficients are realized by a binary word that 
employs 8 bits to the right of the binary point. Then the fractional part of the coefficient can be 
represented as [4] 


1 1 1 1 
fraction = b*S + bet + bs fee a bots 
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where b; is the ith bit, and has a value of either 0 or 1. For example, the binary number 
1 

(0.11000001), = ( Fot :) = (0.75390625) 9 

2 2 2°/ 10 


The maximum value that the fraction can assume is [1 — 1/(2)°}, or 0.99609375. Note, in 
Example 8.1, that a denominator coefficient of 0.999300 is required, but a value of 0.99609375 
will be implemented (b; to bọ are all equal to 1). The numerator coefficients, when converted by 
standard decimal-to-binary conversion algorithms [4], become 


(0.3890) 9 = (0.01100011), = 0.38671875 

(0.3883) 1) = (0.01100011), = 0.38671875 
Thus the compensator zero has been shifted to z = 1, and the digital filter that is implemented 
has the transfer function 


0.38671875z — 0.38671875 
z — 0.99609375 


D(z) = 


Shown in Fig. 8-9 are the frequency responses of the designed filter and the implemented filter, 
and the effects of coefficient quantization are evident. The resultant system stability margins, 


dBA 


0.01 
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FIGURE 8-9 Frequency responses of designed and of realized digital controllers. 
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when the implemented filter is used, are phase margin 72.7° (designed value 55.9°) and gain 
margin 18.1 dB (designed value 16.8 dB). However, the implemented filter has a dc gain of zero; 
thus the system will not respond correctly to a constant input. Hence more bits must be used to 
represent the filter coefficients. 

We can view the coefficient quantization problem as one that results from the choice of the 
sample period T. We place digital filters in a physical system in order to change its real (s-plane) 
frequency response, and we want this change to occur over a certain real frequency (w) range. 
The choice of T places this frequency range on a certain part of the unit circle in the z-plane, 
since z = e/°? = 12 (wT). Thus since phase-lag filtering occurs for w small, the choice of T to 
be small requires that the filtering occur in the vicinity of the z = 1 point. Thus the phase-lag 
pole and zero will occur close to z = 1, and thus close to each other. If T can be chosen to be a 
larger value, the phase-lag pole and zero will move away from the z = 1 point (and each other), 
and the numerical accuracy required for the filter coefficients will not be as great. 


8.5 PHASE-LEAD COMPENSATION 


Phase-lead compensation will now be discussed. For a phase-lead compensator, in (8-13) 09 < @yp 
and the compensator frequency response is as shown in Fig. 8-10. The maximum phase shift, Oy, 


occurs at a frequency Wm, Where Wn is the geometric mean of w,,9 and @,,,, that is, 


Owm = V OyoOwp (8-22) 


A plot of Oy versus the ratio ©,,,/@,9 is given in Fig. 8-11. This plot was obtained through the 
following development. We can express (8-13) as 


1 + j(@,,/0,0) 
F — ‘ Q — wh Wy 
D(jo) = | D(ja,,) |e” = al P (8-23) 
1+ J(@w/Owp) 
Then 
= =) Ow -1w | _ 
tanð = tan} tan — tan = tan(a — B) (8-24) 
Owo Owp 
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FIGURE 8-10 Phase-lead digital filter frequency-response characteristics. 


8.6 Phase-Lead Design Procedure 
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FIGURE 8-11 Maximum phase shift for a phase-lead filter. 
Thus 


tana —tanB _ O/O — Oy/@Oyp 


1 + tan atan B 1 + o/00 


tan 0 = (8-25) 


wp 


1 Awp w0 | 
tanOy = =|,/ 4] 8-26 
il | wo Owp ( ) 
From this equation, 8, is seen to be a function only of the ratio w 
(8-26). Note also that 


Then, from (8-22) and (8-25), 


wp/@o- Figure 8-11 is a plot of 


MELOO EROF [Owp 
| DG@m)| = a (ww ai = a (Owp 0) = a P (8-27) 
VI+ (w,,/@ ) 1+ (®0/Myp) w0 


wp w= Owm 

It is seen in Fig. 8-10 that phase-lead compensation introduces phase lead, which is a 
stabilizing effect, but also increases the high-frequency gain relative to the low-frequency gain, 
which is a destabilizing effect. Design using phase-lead compensation is illustrated in Fig. 8-12. 
The phase lead is introduced in the vicinity of the plant’s 180° crossover frequency, in order to 
increase the system’s stability margins. Note that system bandwidth is also increased, resulting 
in a faster time response. For Fig. 8-12, the compensator dc gain is unity. 

The design of phase-lead compensation tends to be a trial-and-error procedure since, in the 
frequency range that the stabilizing phase lead is added, destabilizing gain is also added. Given 
in the next section is a procedure that will yield a specified phase margin, but has no control on 
the gain margin. 


8.6 PHASE-LEAD DESIGN PROCEDURE 


Presented in this section is a design procedure that will yield a specified phase margin in a dis- 
crete control system, provided that the designed system is stable. That is, the procedure will set 
the gain and phase of the open-loop function to specified values at a given frequency, and we 
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FIGURE 8-12 Design using phase-lead compensation. 


choose the specified gain to be 0 dB and the specified phase to be (180° + p,n), where p, is the 
desired phase margin. Thus the procedure does not determine the gain margin, and may in fact 
result in an unstable system. Then, as a later step in the design procedure, it will be necessary to 
check the gain margin to ensure that it is adequate. 

The characteristic equation for the system of Fig. 8-6 is 


1 + D(w)G(w) = 0 


where D(w) is given by (8-13). Our design problem may then be stated with respect to this 
system: 
Determine D(w) in (8-28) such that, at some frequency o,,, 


D(joy,)GGo,,)) = 12 (180° + bn) (8-28) 


and, in addition, the system possesses an adequate gain margin. 
The design equations will now be developed. Let D(w) be expressed as 


aw + dy _ $ + rrean 
= a 


AMS eri 1+ w/b)? 


(8-29) 


8.6 Phase-Lead Design Procedure 


where dp is the compensator dc gain. Then, in (8-13), (8-14), and (8-15), 


a 1 
ono = a” Oy = 5 (8-30) 


This notation is more convenient than that used for the phase-lag compensator. 
From (8-28) we see that D(jw,,,) must satisfy the relationships 


1 


D(j Sie ee 
EE] 


(8-31) 
and 
LDGOw1) = 14180° + pm) — LGC) 


where the symbol /D denotes the angle associated with the complex number D. Let the angle 
associated with D(jw,,,) be denoted as 0; that is, 


8 = LD joy) = 180° + by — LG(jorw1) (8-32) 
In the equation for D(w), (8-29), we see that there are three unknowns, namely, dp, a4, and 
b,. Equations (8-31) and (8-32) give two constraints on D(jw,,,). Solving these two equations for 


a, and b as functions of ag and w,,; yields 


_ 1 = ao|G(jo,,))|cos8 


(8-33a) 


a y 
i Owi] Goy) | sind 


0 - Gj w 
p, = £080 — aol Ger) (8-33b) 


@,y1sin® 


(See Appendix I.) In the case that the sensor transfer function H(s) is not unity, replace G(jw,,,) 
with GH(jo,,;) in (8-31), (8-32), and (8-33). 

If the compensator coefficients satisfy the preceding equations, the Nyquist diagram will 
pass through the point 14 (180° + m). If the designed system is stable, this system has the 
required phase margin. However, nothing in the design procedure guarantees stability. Thus, 
once the coefficients are calculated, the Bode diagram (or Nyquist diagram) must be calculated 
to determine if the closed-loop system is stable. 

This design procedure requires that the compensator dc gain dp and the system phase-margin 
frequency w,,, be chosen. Then (8-33) determines the compensator coefficients a, and b,. The 
compensator dc gain is usually determined by steady-state specifications for the control system. 
The frequency w,,,; can be approximately determined in the following manner. Since the compen- 
sator is phase lead, the angle 0 of (8-32) must be positive. Thus, from (8-32), 8 > 0 yields 


1. ZG(joy1) < 180° + p, 
Also, | D(jw,,,)| > dp from Fig. 8-10 and from (8-31), 

2. | GGw,,1) | < 1/ao 
In addition, the coefficient b; must be positive, to ensure a stable controller. Thus, from 
(8-33), 
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3. cos > a| G(jo,,1) | 
Hence, the phase-margin frequency w,,; must be chosen to satisfy these three constraints. 


It should be noted that (8-33) may also be utilized in phase-lag filter design, since noth- 
ing in the development of these equations is based on the filter begin phase lead. For phase-lag 
design, three equivalent constraints on w,,; can be developed (see Problem 8.6-3). 


EXAMPLE 8.2 


Consider again the system of Example 8.1, whose frequency response is given in Figure 8-8 and 
Table 8-1. A phase margin of 55° is to be achieved, and a unity-dc-gain phase-lead compensator will 
be employed. Consider Table 8-1. We must choose a frequency w,,; such that L G(j@,,1) < —125° 
(constraint 1) and | G(jo,;)| < 1 (constraint 2). We rather arbitrarily choose wp, = 1.200 to 
satisfy these two constraints, and from Table 8-1, G(jw,,;) = 0.4574Z(—172.9°), From (8-32), 


© = 180° + 55° — (—172.9°) = 407.9° = 47.9° 


Constraint 3 yields cos 47.9° = 0.670 > 0.4576, and all constraints are satisfied. Hence, from 
(8-33), 


1 — (1)(0.4574) cos(47.9°) 
(1.2)(0.4574) sin(47.9°) 


a = 1.703 


js EE SOO E 5557 
(1.2) sin(47.9°) 


and thus, from (8-29), 
_ 1+ 1.7028w 1 + w/0.5873 


Dw) 
1+0.2397w 1 + w/4.1719 


We then obtain the filter transfer function from (8-14): 


_ 6.5278(z — 0.9711) 
z— 0.8111 


D(z) 


Calculation of the system open-loop frequency response shows that this compensator results in a 
phase margin of 55° and a gain margin of 12.4 dB. If we choose ,,; as a value different from 1.2 
above, the phase margin will remain at 55°, but the gain margin will be different. If w,,, is chosen 
larger, then 0, the angle of D(jo,,1), is larger (see Table 8-1), and the ratio @,,,/@,,9 is larger. 
Thus, from Fig. 8-10, the high-frequency gain increases, which increases the system bandwidth. 
Choosing w,,; less than 1.2 will reduce the system bandwidth. The calculations in this example 
are implemented in the MATLAB program: 
>> Gp = t£([2],[1 3 2 01); 


Gz = c2d(Gp,.05); tAssumes ZOH; 
disp('Enter the required parameters: ') 


8.6 Phase-Lead Design Procedure 


a0 = input('Filter dc gain a0 = '); % enter 1 

Pm = input('Desired phase margin Pm = '); % enter 55 

wwl = input('Phase margin frequency wwl = '); % enter 1.2 
[magGwwl1,phaseGwwl1] = bode (Gz, ww1) 


thetad = 180+Pm-phaseGwwl; thetar = thetad*pi/180; 


o 


% Find D(w) using equation (8-33) 


disp(' ') 

disp('D(w) = [al*w + a0]/[b1*w + 1] ') 

al = (1-a0*magGwwl*cos (thetar) ) / (wwl*magGwwl*sin(thetar) ) 
ad 

b1 = (cos (thetar) -a0*magGww1) / (ww1*sin(thetar) ) 


% Find D(z) using equations 8-30 and 8-15 

ww0 = a0/al; wwp = 1/b1; T=0.05; 

Kd = a0* (wwp* (ww0+2/T) ) / (wwO* (wwp+2/T) ); 

z0 = (2/T-ww0)/(2/T+ww0); zp = (2/T-wwp) /(2/T+wwp) ; 

Dz = Kd*tf£([1 -z0], [1 -zp],T); 

Dz = zpk(Dz) 

disp('Gain and Phase Margins: ') 

Gp = tf([2], [1 3 2 0]); Gz = c2d(Gp,T); 

DzGz = Dz*Gz; [Gm,Pm] = margin(DzGz); GmdB = 20*log10(Gm), Pm 


The coefficient quantization problem observed for the phase-lag filter generally does not 
occur in phase-lead filters. For a phase-lag filter, the pole and zero are almost coincident, making 
their placement critical. For the phase-lead filter, the pole and zero are well separated, and any 
small shift in either one has little effect on the filter frequency response. 

Examples 8.1 and 8.2 illustrate simple phase-lag and phase-lead compensation. The 
effect of phase-lag compensation is to reduce the open-loop gain at higher frequencies, which 
in turn reduces system bandwidth. The open-loop gain at lower frequencies is not reduced (can 
be increased), and thus steady-state errors are not increased (can be reduced). The effect of 
phase-lead compensation is to increase open-loop gain at higher frequencies, and thus increases 
system bandwidth. 

The frequency and step response curves for Examples 8.1 and 8.2 are plotted in Figs. 8-13 
and 8-14 by the MATLAB program: 


>> T = 0.05; Gp = tf£([2],[1 3 2 0]); Gz = c2d(Gp,T); 
Dz_lag = t£([0.3890 -0.3883],[1 -0.9993],T); 

Dz lead = 6.5278*t£([1 -0.9711], [1 -0.8111],T); 
Dz_lagGz = Dz_lag*Gz; 

Dz_leadGz = Dz _lead*Gz; 

% Plot Figure 8-13 

figure (1) ,bode(Gz,'-k',Dz lagGz,'--k',Dz leadGz,'-.k'),grid 


2 


% Plot Figure 8-14(a) 


Cz_uncomp = feedback (Gz,1) ; 

Cz_lag = feedback (Dz lagGz,1); 

Cz_ lead = feedback(Dz leadGz,1) ; 

figure (2) ,bode(Cz_uncomp,'-k',Cz_lag,'--k',Cz_lead,'-.k'),grid 
% Plot Figure 8-14(b) 

figure (3),step(Cz_uncomp,'-k',Cz_lag,'--k',Cz_lead,'-.k'),grid 


The open-loop frequency responses of the system of the foregoing two examples without 
compensation, with phase-lag compensation, and with phase-lead compensation are shown 
in Fig. 8-13. Figure 8-14(a) gives the magnitudes of the closed-loop frequency responses 
for the two examples and for the uncompensated system. Note the reduced bandwidth for 
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FIGURE 8-13 Open-loop frequency responses for systems of Examples 8.1 and 8.2. 


phase-lag compensation and increased bandwidth for phase-lead compensation. Shown in 
Fig. 8-14(b) are the step responses of the closed-loop system with phase-lag compensation 
and with phase-lead compensation. Note that the system step response is much faster for 
the phase-lead case, because of the increased system bandwidth. Table 8-2 gives several 
step-response characteristics (see Figure 8-1) for the two cases. Note that while the phase 
margins are equal, the peak overshoots are not. Thus phase margin alone does not determine 
peak overshoot. 


TABLE 8-2 Step-Response Characteristics 


Characteristic Un-compensated Phaselag Phase lead 
Steady-state error 0 0 0 
Percent overshoot 40.51 14.07 11.50 
Rise time, t, (s) 1.55 3.15 1.05 
Peak time t, (s) 4.10 TAS 2.20 
Settling time, t,, for d = 0.02 (s) 16.25 32.35 5.20 


Bandwidth, wp (rad/s) 1.26 0.65 2.19 
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FIGURE 8-14 Closed-loop responses for Examples 8.1 and 8.2: (a) frequency, (b) unit-step. 
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Open-loop frequency response should not be confused with closed-loop frequency 
response. Figure 8-13 is a plot of the systems open-loop frequency responses, and Fig. 8-14(a) 
gives the closed-loop frequency responses for the same systems. Table 8-2 gives the closed-loop 
bandwidths, which were obtained from Fig. 8-14(a). These bandwidths are not available from 
Fig. 8-13 without extensive calculations. We design using the open-loop frequency response, 
for convenience, but the closed-loop frequency response more clearly indicates the input—output 
characteristics of the system. 

An additional point should be made concerning phase-lead compensation. From Fig. 8-10 
we see that the high-frequency gain of the digital filter can be quite large. Hence if the control 
system is burdened with high-frequency noise, the phase-lead compensation may lead to noise 
problems. If this is the case, some compromise in design may be required. One solution involves 
the use of a phase-lag compensator cascaded with a phase-lead compensator. The lag compensa- 
tion is employed to realize a part of the required stability margins, thus reducing the amount of 
phase-lead compensation required. This compensation is discussed in the next section. 

A second possible solution to this noise problem would be to add one or more poles to the 
filter transfer function. The pole (or poles) are placed at high frequencies such that the phase 
lag introduced by the poles does not significantly decrease the system stability margins. The 
required transfer function for a single pole is of the form 


1 


D — 
nw) 1+ WO yp 


and the total filter transfer function is then 


Dw) = ayw + al 1 | 
ý byw +1{1+ W/O yp 1 


The resultant filter frequency response is as shown in Fig. 8-15, for ag = 1. 
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FIGURE 8-15 Phase-lead filter with an added pole. 


8.7 Lag-Lead Compensation 


Another problem originates in the large high-frequency gain of the phase-lead compensa- 
tor. This problem is evident in the filter transfer function of Example 8.2. For this example, 


_ 6.5278 — 6.3391 


= 6.5278 — 1.044477! + --- 
z— 0.8111 


D(z) 


Thus a step change of 1 unit in the filter input results in a step change of 6.5278 units in the filter 
output. This large signal out of the filter may force the plant into a nonlinear region of operation 
(e.g., an amplifier may saturate, or the digital-to-analog converter may saturate). Since the design 
is based on a linear plant model, the effects of forcing the system into nonlinear regions of opera- 
tion will not, in general, be obvious. 


PHASE-LAG PROPERTIES. In summary, some possible advantages of phase-lag compensation are: 


1. The low-frequency characteristics are maintained or improved. 

2. The stability margins are improved. 

3. The bandwidth is reduced, which is an advantage if high-frequency noise is a problem. 
Also, for other reasons, reduced bandwidth may be an advantage. 


Some possible disadvantages are: 


1. The reduced bandwidth may be a problem in some systems as it slows down the system 
response. 

2. The system transient response will have one very slow term. This will become evident 
when root-locus design is covered in Section 8.11. 

3. Numerical problems with filter coefficients may result. 


PHASE-LEAD PROPERTIES. For phase-lead compensation, some possible advantages are: 


1. Stability margins are improved. 
2. High-frequency performance, such as speed of response, is improved. 
3. Phase-lead compensation is required to stabilize certain types of systems. 


Some possible disadvantages are: 


1. Any high-frequency noise problems are accentuated. 

2. Large signals may be generated, which may damage the system or at least result in nonlin- 
ear operation of the system. Since the design assumed linearity, the results of the nonlinear 
operation will not be immediately evident. 


8.7 LAG-LEAD COMPENSATION 


In the preceding sections, only simple first-order compensators were considered. In many system 
design projects, however, the system specifications cannot be satisfied by a first-order com- 
pensator. In these cases higher-order filters must be used. To illustrate this point, suppose that 
smaller steady-state errors to ramp inputs are required for the system of Example 8.2. Then the 
low-frequency gain of the system must be increased. If phase-lead compensation is employed, 
this increase in gain must be reflected at all frequencies (see Fig. 8-10). It is then unlikely that 
one first-order section of phase-lead compensation can be designed to give adequate stability 
margins. One solution to this problem would be to cascade two first-order phase-lead filters. 
However, if noise in the control system is a problem, the increased gain at high frequencies may 
lead to noise problems. A different approach is to cascade a phase-lag filter with a phase-lead 
filter. This filter is usually referred to as a lag-lead compensator. 
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FIGURE 8-16 Frequency response of a lag-lead filter. 


A lag-lead filter has the characteristics shown in Fig. 8-16. The purpose of the lag section 
is to increase the low-frequency gain, and the lead section increases the bandwidth and the stabil- 
ity margins. The lag-lead filter will now be illustrated by an example. 


EXAMPLE 8.3 


In this example, the system of Examples 8.1 and 8.2 will again be considered. The steady-state 
error to a unit ramp input is given by 


T 
limk — 1)G(@) 


[eq. (6-21)] es(kT) = 


From Example 8.1, 


z- 1f 0.05z 1.5z 2z 0.5z 


+ = 0.05 
z (¢-1% z-1 z-0.9512 z -— 0.9048 


lim (z — 1)G(z) = lim 


Hence, from (6-21), 


0.05 
(kT) = 0.05 = 1 


Suppose that the design specifications require a steady-state error to a unit ramp input of 0.50 
and a phase margin of 55°. We will use a phase-lag filter, D(z), to increase the low-frequency 
gain by a factor of 2, to satisfy the steady-state error criterion. Then we design a phase-lead filter, 
D(z), to yield the 55° phase margin. We will choose the pole-zero locations of D,(z) to be the 
same as those of the phase-lag filter in Example 8.1. Then 


magsi K,(z — 0.9982) 
= hm = hm = 
ao I ars z — 0.9993 


From this expression we see that K4 = 0.7778, or 


0.7778(z — 0.9982) 
z — 0.9993 


D\(z) = 


8.7 Lag-Lead Compensation 


To design the phase-lead filter, we must calculate the frequency response D,(z)G(z). The equa- 
tions of Section 8.6 can then be utilized to find the phase-lead filter transfer function D(z). We 
use ®y; = 1.20, as in Example 8.2. Calculation of the required frequency response yields 


D,(w)GW)|»=1.20 = 0.3557Z(— 173.93) 


We now substitute these values into (8-32) and (8-33), with G(jw,) in these equations replaced 
with D(jw,)G(jw,) above. Hence, from (8-32), 


@ = 180° + 55° — (—173.93°) = 408 .93° = 48.93° 


From (8-29) and (8-33), with aọ = 1, 


1 1 — (1) (0.3557) cos(48 .93°) 1 
a, = = n na = 2.3814 = 
wyo (1.2) (0.3557) sin(48 .93°) 0.4199 
and from (8-33b), 
1 48 .93°) — (1)(0.3557 1 
Hie __ cos( ) (1)¢ : re 0.3331 = = 
yp (1.2) sin(48 .93°) 3.002 


Then D,(w) = (1 + w/0.4199)/1 + w/3.002). Thus, from (8-14), 


6.7206(z — 0.9792) 
z — 0.8604 


D(z) = 


The total filter transfer function is 


5 .2273(z — 0.9982)(z — 0.9792) 
(z — 0.9993)(z — 0.8604) 


DZ) = DZ) DZ) = 


The filter’s DC gain is 2.003. A sketch of the Bode diagram for this filter is shown in Fig. 8-17. 
Calculation of the compensated system open-loop frequency response shows that the compen- 
sated system has a phase margin of 55° and a gain margin of 11.2 dB. The step response for this 
system is plotted in Fig. 8-18, together with those from Examples 8.1 and 8.2. Note that the step 
responses of the phase-lead system and the lag-lead system are approximately the same; how- 
ever, the steady-state error for a ramp input for the lag-lead system is only one-half that for the 
phase-lead system. 
The calculations and plots in this example are implemented in this MATLAB program. 


>> Gp = t£([2],[1 3 2 0]); T=0.05; 
Gz = c2d(Gp,T); tAssumes ZOH; 

% Set up lag filter 

Diz = 0.7778*tf£([1 -0.9982], [1 -0.9993],T); 
Diz=zpk(D1z); D1lzGz=D1z*Gz; 

disp('Enter required design parameters: ') 


a0 _D2 = input('D2(z) filter dc gain a0_D2 = '); % enter 1 
Pm = input('Desired system phase margin Pm = '); % enter 55 
wwl_D2 = input('Phase margin frequency wwl_D2 = '); % enter 1.2 


[magD1Gww1,phaseD1Gwwl1] = bode (D1zGz,wwl1_D2) 

thetad = 180+Pm-phaseD1Gwwl; thetar = thetad*pi/180; 
% Find lead filter D2(w) using equation (8-33) 
disp('D2(w) = [al_D2*w + a0_D2]/[b1_D2*w + 1] ') 


al_D2 = (1-a0_D2*magD1Gwwl1*cos (thetar) ) / (ww1_D2*magD1Gww1*sin(thetar) ) 
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FIGURE 8-18 Step responses for Examples 8.1, 8.2, and 8.3. 
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b1_D2 = (cos(thetar) -a0_D2*magD1Gww1) / (ww1_D2*sin(thetar) ) 
% Find lead filter D2(z) using equations 8-30 and 8-15 

ww0 D2 = a0 _D2/al_D2; wwp_D2 = 1/b1_D2; 

Kd_D2 = a0_D2* (wwp_D2* (ww0_D2+2/T) ) / (wwO_D2* (wwp_D2+2/T)) ; 

z0_D2= (2/T-ww0_D2)/(2/T+ww0_D2); zp D2 = (2/T-wwp_D2)/(2/T+wwp_D2) ; 
D2z = Kd_D2*tf([1 -z0_ D2], [1 -zp_D2],T); D2z = zpk(D2z) 

% Find the lead-lag filter D1(z) *D2(z) 

Dz_laglead=D1z*D2z 

Dz_lagleadGz = Dz laglead*Gz; 

% Find the stability margins 

disp('Gain and Phase Margins: ') 

[Gm_laglead,Pm_laglead] = margin(Dz lagleadGz) ; 

GmdB_laglead = 20*log10(Gm_laglead), Pm_laglead 

% Plot Figure 8-17: lag-lead filter frequency response 
figure(1), bode(Dz laglead,'-k'), grid 

% plot Figure 8-18: Step responses for Examples 8.1-8.3 

DZ lag = tf£([0.3890 -0.3883],[1 -0.9993],T); 

Dz lead. = 6.5278*t£( [1 =-0.9711] [4 =0.8111] T]; 

Dz_lagGz = Dz_lag*Gz; 

Dz_leadGz = Dz _lead*Gz; 

Dz_lagleadGz = Dz laglead*Gz; 

Cz_uncomp = feedback (Gz,1) ; 

Cz_ lag = feedback (Dz lagGz,1); 

Cz_ lead = feedback(Dz leadGz,1) ; 

Cz_ laglead = feedback(Dz lagleadGz,1) ; 

figure (2),step(Cz_lag,'--k!',Cz_lead,':k',Cz laglead,'-k'),grid 
stepinfo(Cz_ laglead) 


8.8 INTEGRATION AND DIFFERENTIATION FILTERS 


A somewhat different controller is presented in this and the following section. This controller is 
used extensively in many different industries. 

To introduce this controller, we first consider a technique for digital-filter integration. 
Suppose that we desire to integrate a signal e(t) digitally, and to accomplish this, we will use the 
trapezoidal technique [6]. The trapezoidal rule is illustrated in Fig. 8-19. 

Let m(kT) be the numerical integral of e(t). Then, from Fig. 8-19, the value of the integral 
at t = (k + 1)T is equal to the value at AT plus the area added from kT to (k + 1) T. From 
Fig. 8-19, 


mU(k + 1)T] = m(kT) + Tiek + 1)T] + e(kT)} (8-34) 


e(t) 


e(kT) 
J [e(k+1)T] 


~ 


N kT (k+DT T 


`~ 


FIGURE 8-19 Trapezoidal rule for numerical integration. 
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Taking the z-transform, we obtain 


zM(z) = M(z) + TREO + EQ) (8-35) 


Thus 


Mz) _ aE + L (8-36) 


KƏ 2\Lz-1 

Hence (8-36) is the transfer function of a discrete integrator. Of course, there are many other dis- 

crete transfer functions that may be used to integrate a number sequence as shown in Section 6.6. 
Now consider a technique for the digital-filter differentiation of a function e(t). Figure 8-20 

illustrates one method. The slope of e(t) att = kT is approximated to be the slope of the straight 

line connecting e[(k — 1)T] with e(kT). Then, from Fig. 8-20, letting the numerical derivative of 

e(t) at t = kT be m(kT), we can write 


ae e(kT) — = — 1)T] an 


The z-transform of this equation yields 


M@) _z71 
E(z) Tz 


(8-38) 


Note that this differentiator is the reciprocal of the transfer function for the rectangular-rule 
integrator (see Problem 2.2-1). In general, the reciprocal of the transfer function of a numerical 
integrator can be used as the transfer function of a numerical differentiator. For the development 
in this section, we use (8-36) and the reciprocal of this transfer function for integration and dif- 
ferentiation, respectively. Then, from (8-36), letting D,(z) be the integrator transfer function, we 
obtain 


ne (a) 1 E 
w = — =— — = 
i 2\z = T/|e=p4+c wit -T2w] w 


el(k— 1)T] 


N (k-1)T kT 


`~ 


FIGURE 8-20 Illustration of numerical differentiation. 
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Letting Dp(z), the differentiator transfer function, be the reciprocal of (8-39), 


Dp(w) = Dp(2)|2=[1+(rewvtt—-(TREVw) = W (8-40) 


Recall that for continuous systems, a differentiator has a transfer function of s, and an 
integrator a transfer function 1/s. The frequency responses are obtained by replacing s with jw. 

The frequency responses of the discrete transfer functions (8-39) and (8-40) will now be 
compared with those of the continuous integrator and differentiator. From (7-10), 


2 T 
oy = Flan (8-41) 
For w7/2 small, we see that 
WO, ~ (8-42) 
For the integrator transfer function (8-39), 
. 1 
Dijon) ~ ~— (8-43) 
IOw 
Substituting (8-42) into (8-43), we obtain 
i 1 
Dijo) ~ > (8-44) 
jw 


In a similar manner, 


Dp(jow) = jow Si jo 


These approximations are good provided that since w, = 27/T, 


tan; o> | = tan| 7— | ~ 7T_ 
2 Ws Ws 
If this expression is satisfied, we would expect to obtain accurate differentiation and integration 
for (8-40) and (8-39), respectively. 


8.9 PID CONTROLLERS 


We will now discuss a frequency-response design technique that considers phase-lead 
phase-lag controllers from a somewhat different viewpoint. The resultant controller, called 
a proportional-plus-integral-plus-derivative (PID) controller, has the block diagram shown in 
Fig. 8-21. This controller is a special type of the lag-lead controller. 

The transfer function of a digital PID controller, using the integrator and differentiator 
transfer functions developed in the preceding section, is given by 


K 
Diw) = Kp + — + Kow (8-45) 
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+ 

K Numerical 

D differentiator 


FIGURE 8-21 Discrete PID controller. 


In this expression, Kp is the gain in the proportional path, K; the gain in the integral path, and Kp 
the gain in the derivative path. 
Consider first a proportional-plus-integral (PI) controller. The filter transfer function is 


K; Kpw + K; 1+ W/0),,9 
oe ae ee =K, (8-46) 
w w w 


where w„o = K;/Kp. Note that this is a phase-lag filter of the type given in (8-13), with the pole 
placed at wp = 0. The filter frequency response is illustrated in Fig. 8-22. 

Note that the PI controller low-frequency gain is increased (infinite at w„ = 0), and thus 
steady-state errors are reduced. The purpose is then the same as that of the phase-lag controller 
of (8-13): to increase stability margins and/or reduce steady-state errors. 

Consider next the PD (proportional-plus-derivative) controller. The filter transfer function is 


Dw) = Kp + Kpw = K(i $ ~) (8-47) 
w0 


dB 4 


20 log K, 
i 
| 
i 
1 
Phase 4 i 
i 
0° i 2 
Log w, 
—45° 
—90° 


FIGURE 8-22 Frequency response for a PI controller. 
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FIGURE 8-23 Frequency response for a PD controller. 


where ,,9 = Kp/Kp. Note that this is a phase-lead controller of the type given in (8-13), with the 
pole placed at w,,, = %. The filter frequency response is illustrated in Fig. 8-23. The purposes 
of the PD controller are to add positive phase angles to the open-loop frequency response so as 
to improve system stability, and to increase closed-loop system bandwidth so as to increase the 
speed of response. The effects of the PD controller appear at high frequencies, as opposed to the 
low-frequency effects of the PI controller. 

The PID filter is a composite of the two filters discussed above and has the transfer function 


K, 
Dw) = Kp + + Kpw (8-48) 


The frequency response of the PID controller is illustrated in Fig. 8-24. From (8-48), 


O Kpw? + Kpw + K, KA + wow + w/owo) 


D(w) 
w w 


Hence the filter has two zeros, @,,9; and w„o2, and two poles, with one at w,, = 0 and the 
other at w,, = œ. The design techniques can follow those given for phase-lag (the PI part) and 
phase-lead (the PD part) filters. However, a different design procedure will be developed in the 
following section. Since the Kp term is common to both the PI and PD parts, the design of the PD 
part affects the PI part, and vice versa. 

A problem is obvious in the use of the PID filter. As is seen in Fig. 8-24, the filter gain con- 
tinues to increase without limit as frequency increases. As w,, approaches infinity, w approaches 
w,/2 and z approaches —1. In general, G(z) does not have a zero at z = —1. Thus | G(z)D(z) | 
will approach infinity as z approaches —1, which will probably lead to encirclements of the —1 
point on the system Nyquist diagram. Hence the system will be unstable, and the compensator of 
(8-48) is not practical. To avert this problem, a pole (or poles) must be added to the derivative 
term, resulting in the filter transfer function 


Kı Kpw 


D(w) = Kp + + 
a P Ww [Ia + W/O pi) 


(8-49) 
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FIGURE 8-24 Frequency response for a PID controller. 


The usual solution to this problem is to add a single pole using the differentiator of Fig. 8-20, 
which has the transfer function given in (8-38). 


g= k w w 
Dp(w) = = = (8-50) 
p Tz |=u+w- anw 1+ (T2w 1+ (Wow 


Hence this algorithm for differentiation adds a pole at 2/T; and since w, = 2%7/T, then 


— 2 ws 
Owp = T 


This pole position is normally well outside the bandwidth of the system and will contribute very 
little phase lag at the frequency that the phase margin occurs. Hence in many cases this pole can 
be ignored (at least initially) in the design process. If high-frequency noise is a problem in the 
control system, additional poles may be required in the derivative term. 

A practical PID filter transfer function as a function of z is, from (8-45), (8-36), and (8-38), 


Tiz+1 =f 
D) = Kp + HE | $ X= | (8-51) 
2Lz—-1 Tz 
which may be reformulated as 
zZ +az+b 
D(z) = K-——— 
az — 1) 


Kı = Kp + KyTl2 + Kp/T 
a = (K,;TI2 — Kp — 2Kp/ T/K; 
b = Ky(TK,) (8-52) 
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This filter uses trapezoidal integration and the differentiation of (8-38) and Fig. 8-20. The filter 
difference equations can be written directly from this equation (see Problem 8.9-1). In some 
cases it is possible to determine Kp, K;, and Kp experimentally using the physical control system, 
when only a rudimentary knowledge of the plant characteristics is available. An educated guess 
of Kp, K;, and Kp is made, which must result in a stable closed-loop system. Then Kp, K; and Kp 
are varied in some systematic manner until an acceptable response is obtained. A somewhat dif- 
ferent form of the PID controller transfer function is considered in Problem 8-9-2. 

The PID controller offers an advantage if, for some reason, the sample period T must be 
changed after the system design has been completed. Suppose that for a given design, T is chosen 
such that accurate differentiation and integration occur. If for a different value of T, accurate differ- 
entiation and integration still occur, the gains Kp, K;, and Kp will not change. Hence a new design 
is not required. A design procedure for PID controllers will be developed in the following section. 


8.10 PID CONTROLLER DESIGN 


In this section a design process is developed for PID controllers [6]. The development will 
closely parallel that of Section 8.6 for phase-lead filters (controllers). We assume initially that 
the PID controller has a transfer function given by 


Kı 
[eq. (8-45)] D(w) = Kp + w + Kpw 


Hence we are ignoring the effects of the required pole of (8-50) in the derivative path; 
these effects will be considered later. The controller frequency response is given by 


Djon) = Kp + j(Kp®y — Kilon) = |DGon) |e” (8-53) 


Here, as in Section 8.6, the design problem is to choose D(w) (i.e., choose Kp, K;, and Kp) 
such that 


D( joy GG@ 1) = 1Z(—180° + dyn) (8-54) 


at a chosen frequency w,,,;. Now, from (8-53), 
Kı ; as 
K, + j\{Kp@y1 — a = | Dow) |(cosð + jsin 6) (8-55) 


where from (8-53) and (8-54), 
6 = —180° + b,, — LG) (8-56) 
Therefore, from (8-54) and (8-55), 


cos 0 
| G( joys) | 
Kr _ sin@ 
Ow | G( jow) | 


Kp = |D(jo1)|cos 0 = (8-57) 


(8-58) 


Kp@y1 
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In these design equations, if the transfer function of the sensor H(s) is not unity, G(jo,,,) is 
replaced with GH (jo,,1). 

The design equations are then (8-56), (8-57), and (8-58). For a given plant, G(w), the 
choice of w,,; and ,, uniquely determines Kp, from (8-57). However, Kp and K; are not uniquely 
determined, as is evident in (8-58). This results from (8-55) yielding two equations, but with the 
three unknowns Kp, K;, and Kp. In satisfying (8-58), in general increasing Kp will increase the 
bandwidth, while increasing K; will decrease steady-state errors, provided that the system retains 
an acceptable gain margin. Note that if (8-57) and (8-58) are satisfied, varying Kp and Ky will 
change the gain margin, while the phase margin remains constant. 

Equations (8-57) and (8-58) also apply to the design of PI and PD controllers, with the 
appropriate gain (Kp or Kp) set to zero. For this case all gains are uniquely determined. 

As shown in Section 8.9, in general a pole is required in the derivative term. A commonly 
used transfer function was given in (8-50), which results in a PID controller transfer function 


Mise te (8-59) 
is P? w Tose CEO Ww i 


Then 


Kı Kpj@y 
D(jw,,) = Kp — j 
al ae a TA jo,T/2 
Kpo,,(2/T) ( Kpw,Q2/TY K; 
Kp + 2 2) td 2 2 
(2/TY + o2 QITY + w2, Wy 


cos@ + jsin 0 


Rer (8-60) 
| G( jowi) | 
By equating the real and imaginary terms, (8-57) and (8-58) become 
Kpo,1(2/T) o 
Kp + —— / = (8-61) 
(2/T) F Ow | Gjo,,1) | 
and 
Kpo,,2/TY K, ind 
py (2/T) I sin (8-62) 


(ITF + oZ Ow! | G(jo1) | 


Note that if w„ı < 2/T, these equations reduce to (8-57) and (8-58); otherwise, no simple pro- 
cedure has been found for calculating Kp, Kj}, and Kp. For the PI controller, (8-61) and (8-62) 
contain only two unknowns and may be solved directly 


cos0 w,,;sin8 
Kp. yy) AES Oe T (8-63) 
C [Gow] | GUjew)| 


For the PD controller, (8-62) and (8-61) also contain only two unknowns and may be solved 
directly for 
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-| sin 0 [2] cos 0 Kpoy(2/T) (3-64) 
PL GGow | IL 2/TPey1 P [Gon]  @/TY + o 


Two examples of PID design will now be given. 
EXAMPLE 8.4 


First the design problem of Example 8.3 will be repeated, but a PI filter will be utilized. In Example 8.3 
we required a 55° phase margin and a steady-state error to a unit ramp input of 0.5. Since D(z) adds 
a pole atz = 1 to the one already present in G(z), then D(z)G(z) has two poles at z = 1. Thus the 
steady-state error to a ramp input is zero (see Section 6.5), satisfying the steady-state error design 
criteria. From Table 8-1, the frequency response of G(z), we choose w, = 0.400. Then 


G(jwy1) = G(j0.4) = 2.27612 (— 123.68") 
From (8-56), 
@ = 180° + 55° — (—123.68°) = 358.68° = —1.32° 


We see then that the phase angle of the filter is very small at the phase-margin frequency, as 
desired. Then, from (8-63), 


_ cos(—1.32°) _ 0.4392 

á 2.2768 i 

—sin(—1.3°) 
K; = 0.4 = 0.0040 
2.278 
From (8-52), the PI controller is 
0.4393z — 0.4391 

D(z) = z 


Z 


From (8-46), the zero of the PI controller is placed at 


Kı 
wo = = = 0.0092 

Kp 
which is quite low. Hence we have reduced the system bandwidth considerably. Even though 
we get good steady-state error response, a relatively long time will be required to achieve it. The 
gain margin is 16.0 dB and the phase margin is 55°. The unit-step response displays the rise time 
(2.95 s), overshoot (13.8%), and settling time (19.4 s). The system responds to a unit ramp with 
an error of 1.99 s after 20 s, and has decreased to only 1.52 s at the end of 50 s. If we choose 
,,, = 0.3, the PI gains are calculated as Kp = 0.3125 and K; = 0.0154. Then 


— 0.31292 — 0.3121 
z=] 


D(z) 


and 
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and the system bandwidth has been increased. For this PI controller, the gain margin is increased 
to 18.4 dB, the phase margin is 55°, the unit-step rise time is delayed to 3.65 s, the overshoot is 
increased to 18.6%, and the settling time is delayed to 43.0 s. The error to a unit-ramp input is 
reduced to 1.37 s after 20 s, and has decreased to 0.27 s at the end of 50 s. 

A MATLAB program that performs the above calculations is given by 


>> Gp = tf£([2],[1 3 2 0]); T=0.05; 

Gz = c2d(Gp,T); tAssumes ZOH; 

Pm = input('Desired system phase margin Pm = '); % enter 55 

wwl = input('Phase margin frequency wwl = '); % enter 0.4 & 0.3 
[magGwwl1,phaseGwwl1] = bode (Gz, ww1) 

thetad = 180+Pm-phaseGwwl; thetar = thetad*pi/180; 

KD = 0; 

% Equation (8-63) 

KP = cos(thetar) /magGwwl, KI = -wwl*sin(thetar) /magGwwl 
ww0=KI/KP 


2 


% Equation (8-52) 

Dz = KP+(KI*T/2)*t£((1 1], [1 -1],T)+(KD/T)*t£([1 -1],[1 0],T) 
DzGz = Dz*Gz; 

Cz=feedback (DzGz,1); 

disp('Gain and Phase Margins: ') 

[Gm, Pm] = margin(DzGz); GmdB = 20*log1l0(Gm), Pm 
disp('Unit-step performance metrics:') 

stepinfo (Cz) 

step2ramp = tf([T], [1 -1],T); % Converts unit-step to unit-ramp 
ct = step(step2ramp*Cz,60); % Generates c(t) 

disp('Unit-ramp errors at 20 s and 50 s:') 

ct20err = 20-ct(20/T) error = 20 - c(20) 

et50err = 50-ct(50/T) % error = 50 - c(50) 


o 


EXAMPLE 8.5 


The design problem of Example 8.4 will be repeated, except that in this example a PID controller 
will be utilized. The design equations (8-57) and (8-58) will be used (i.e., initially the pole in the 
derivative term will be ignored). From (8-57), 


_ cos ð 
| GC jowi) | 


Thus the larger we choose «,,;, the smaller is |G(jw„)| (see Table 8-1), and hence the 
larger is Kp. This increases the open-loop gain, which is desirable for many reasons. We choose 
@y, = 1.2. Then 


Kp 


G(jo,,;) = G(j1.2) = 0.45742 (—172.88°) 
From (8-56), 
6 = 180° + 55° — (—172.88°) = 407.88° = 47.88° 


and from (8-57), 


ps cos(47.88°) _ 1.4664 
á 0.4574 ; 
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From (8-58), 


Ky sin8 
Owl | GUM y1) | 


Kpop 
Hence, with G(jw,,,) from above, 
sin(47.88°) | 1 1Y 
Kp = + Ki 
0.4574 ]1.2 1.2 


= 1.3513 + 0.6944K, 


If K; is chosen as 0.004 as was the case in Example 8.4, then Kp is 1.3541. From (8-52), the 
resulting PID controller is 
_ 28.55z° — 55.63z — 27.08 


D 
a Ee 


This configuration produces a phase margin of 53.7° and a gain margin of 23.2 dB. The unit-step 
response displays the rise time (1.00 s), overshoot (14.3%), and settling time (3.60 s). The sys- 
tem responds to a unit ramp with an error of 0.699 s after 20 s. 

Note the error on the achieved phase margin when we neglect the high frequency pole of 
the practical derivative filter in (8-52) and employ (8-57) and (8-58) to compute the PID gains. 
The desired phase margin can be achieved by using (8-61) and (8-62) to compute the PID gains. 
With K; = 0.004 (as determined in Example 8.4) inserted into (8-61) and (8-62), Kp = 1.3553, 
Kp = 1.4177, and the resulting PID controller is 


_ 28.522" — 55.63z — 27.11 


D 
a Z-z 


This controller with slightly modified numerator coefficients produces the desired phase 
margin of 55° and a gain margin of 23.3 dB. The unit-step response displays the rise time 
(1.05 s), overshoot (13.0%), and settling time (3.60 s). After 20 s, the system responds to a unit 
ramp with an error of 0.720 s. 

A MATLAB program that performs the computations in this example is now given. The 
code is set for entering K; and employing (8-61) and (8-62) to compute Kp and Kp. 

>> Gp = tf([2], [1 3 2 0]); T=0.05; 

Gz = c2d(Gp,T); %Assumes ZOH; 


Pm = input('Desired system phase margin Pm = '); % enter 55 
wwl = input('Phase margin frequency wwl = '); % enter 1.2 


KI = input ('Code is to set to enter KI= '); % enter 0.004 
[magGww1 , phaseGww1] = bode (Gz,ww1) 


thetad = 180+Pm-phaseGwwl; thetar = thetad*pi/180 

% disp('Case (a): Use Equations (8-57) and (8-58)') 

% KP = cos(thetar) /magGwwl1 

% KD = (KI/wwl + sin(thetar) /magGww1) /wwl1 

disp('Case (b): Use Equations (8-61) and (8-62) ') 
disp('Option (1): Enter KI, compute KD and KP)') 

KD = (sin(thetar) /magGwwl/wwl + KI/ww1*2)*(1 + wwl*2/(2/T)%*2) 
KP = cos(thetar) /magGwwl - KD*wwl*2/ (2/T+ww1*2*T/2) 

% disp('Option (2): Enter KD, compute KP and KI) ') 

% KP = cos(thetar) /magGwwl1- (KD*ww1*2* (2/T) )/((2/T) *2+ww1*2) 
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FIGURE 8-25 Responses of Examples 8.3 and 8.5. 
% KI = wwl* ( (KD*ww1* (2/T)*2) /((2/T) *2+ww1*2) - sin(thetar) /magGww1) 


% Find Dz using Equation (8-51) 

Dz PID = KP + (KI*T/2)*tf([1 1], [1 -1],T) + (KD/T)*tf([1 -1],[1 0],T) 
Dz_PIDGZz=Dz_PID*Gz; Cz=feedback (Dz_PIDGz,1); 

disp('Gain and Phase Margins: ') 

[Gm, Pm] = margin(Dz PIDGz); GmdB = 20*10g10 (Gm), Pm 

disp('Unit-step performance metrics:') 

stepinfo(Cz), step(Cz) 
step2ramp = tf([T], [1 -1],T); 
ct = step(step2ramp*Cz,60); % Generates ramp response c(t) 
disp('Unit-ramp error at 20 s:') 

et20err = 20-ct(20/T) % error = 20 - c(20) 


% Converts unit-step to unit-ramp 


The step response of the PID controller is shown in Fig. 8-25, together with the step 


response of the lag-lead controller of Example 8.3. For the lag-lead controller the rise time is 
1.05 s; overshoot, 10.8%; and settling time, 5.30 s. For the PID controller, the rise time is 1.05 s; 


the overshoot, 13.0%; and the settling time, 3.60 s. 


MATLAB includes a PID design tool (named pidtool) to automate the computation of the 
control gains. The format for one of MATLAB’s PID controllers (named PIDF) is as follows. 
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T 
DG) = Kp + d= - a pe (8-65) 
7 (ee 


z-1 


where Tp is a parameter that places a high frequency pole to improve performance. Remember 
that the derivative filter in (8-51) places a high frequency pole at a specific location (wp = 2/T). 
Equation (8-65) can be reformulated into the same format as was used in (8-51). 


T 1(z-1 Ty — T 
= Kp + + Kp — = - 
D(z) = Kp Kj- = | PRE = +)), a F (8-66) 


The high frequency pole for this controller is given by 


(15) 
(O n 
j T\l +a 


Note that setting Tr = T makes a = 0 and (8-65) and (8-66) simplify to (8-51). If Ts = 2T, 
Oy, = 2/(ST), reducing the frequency breakpoint by 33.3%. The use of the MATLAB tool is 
illustrated in the following example. 


EXAMPLE 8.6 


The design problem of Example 8.5 will be repeated, except that in this example a PID con- 
troller will be designed using the MATLAB pidtool. The first step is to generate in MATLAB 
the z-transform of the plant (labeled Gz in the previous example). Next, enter the command 
pidtool(Gz). This opens a graphical user interface (GUI) with several options as shown in 
Fig. 8-26. One set of parameters employs (8-66) to calculate (or tune) the PID gains. Choose the 
following set: 


Design Mode: Extended 
Form: Parallel 

Type: PIDF 

Plot: Step 


Response: Reference tracking 


Next click the arrow at the upper-right edge of the window labeled Show parameters. 
Now we are ready to input the controller specifications using the two interactive-tuning slid- 
ers at the bottom of the window labeled Bandwidth and Phase margin. In this case, we set the 
phase margin to 55. We can now set (using the bandwidth slider) the frequency ,,,; at which we 
want to achieve the specified phase margin. MATLAB’s pidtool displays the resulting constants 
(Kp, Kı, Kp, and Tp) in the Controller parameters display area. We can also note the resulting step 
and frequency response parameters in the Performance and robustness display area. Entering 
our desired phase-margin frequency (o,,; = 1.2 rad/s) using the bandwidth slider allows 


320 


Chapter 8 ° Digital Controller Design 


Plot: | Step = Response: | Reference tracking s how baseline Hide parameters 4 
1.4; — = - — + + + Controller parameters 
Tuned 
Kp 1.3091 
Ki 0.01356 
Kd 1.3666 
1.2} Tf 0.10463 


Performance and robustness 


Rise time (seconds) 1 
Serting time (seconds) 3.45 
Overshoot (4) 

Peak 

Gain margin (rad/s) 
Phase margin (rad/s) 
Closed-loop stability 


o 
w 


Amplitude 


ad 
a 


0.4} 


02 


| — Tuned PID 
0 
9 1 2 3 4 5 6 7 
Time (seconds) +. — == 
Interactive tuning 
Bandwidth: 
CQ joes H) [1 2 rad/s 
0.031 0.31 3.1 
Phase margin: 
55 deg 
0 4s 90 


FIGURE 8-26 Screenshot of MATLAB pidtool. Source: Reprinted with permission from 
The MathWorks, Inc. 


pidtool to display the following set of controller parameters (see Fig. 8-26): Kp = 1.3091, 
K; = 0.01356, Kp = 1.3666, and Tr = 0.10463. Inserting these values into (8-65) produces 
14.37(z — 0.9995)(z — 0.9569) 

(z — 1) — 0.5221) 


D(z) = 


The resulting closed-loop performance parameters are rise time, 1.0 s; settling time, 3.45 s; over- 
shoot, 12.9%; gain margin, 17.8 dB; and phase margin, 55°. The following MATLAB program 
computes the designed PID controller transfer function and checks its performance parameters: 


>> T = 0.05; Gp = tf£([2],[1 3 2 0]); Gz = c2d(Gp,T); 
disp(' ') 

disp('Now opening MATLAB pidtool GUI') 

disp('Set Pm = 55, wwl = 1.2') 

pidtool (Gz, 'pidf') 

% Gains from MATLAB pidtool with Pm = 55, wwl = 1.2 
KP = 1.3091, KI = 0.01356, KD = 1.3666, TF = 0.10463 
% Find Dz using Equation (8-65) 

disp('PIDF using Equation (8-65) ') 

Dz_PIDF = KP + (KI*T)*tf£([1],[1 -1],T) + KD*tf£([1 -1], [TF -TF+T] ,T) 
Dz PIDF = zpk(Dz_ PIDF) 
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Dz PIDFGz = Dz PIDF*Gz; 

Cz _PIDF = feedback(Dz PIDFGz,1) ; 

disp('PIDF Gain and Phase Margin: ') 

[Gm, Pm] = margin(Dz PIDFGz); GmdB = 20*log10(Gm), Pm 


% disp('Unit-step performance metrics: ') 
PIDF_ stepinfo = stepinfo(Cz_PIDF) 


The MATLAB pidtool allows us to hold the phase margin at 55° and explore various set- 
tings for our phase-margin frequency design point. Increasing w,,, from 1.2 rad/s to 1.3 rad/s 
has very little effect on the rise time (decreases from 1.0 s to 0.95 s), overshoot (decreases from 
12.9% to 12.6%), and gain margin (decreases from 17.8 dB to 17.5 dB). However, the settling 
time begins to increase more quickly (from 3.45 s to 4.15 s). An additional increase in ,,; to 
1.35 rad/s decreases the rise time to 0.90 s, increases the overshoot to 15.2%, decreases the gain 
margin to 17.1 dB, and dramatically increases the settling time to 14.8 s. 


8.11 DESIGN BY ROOT LOCUS 


In the frequency-response design procedures described above, we attempted to reshape the sys- 
tem open-loop frequency response to achieve certain stability margins, transient-response char- 
acteristics, steady-state response characteristics, and so on. Even though design equations were 
developed, the techniques are still largely trial and error. 

A different design technique is presented in this section: the root-locus procedure. Recall 
that the root locus for a system is a plot of the roots of the system’s characteristic equation as 
gain is varied. Hence the character of the transient response of a system is evident from the root 
locus. The design procedure is to add poles and zeros via a digital controller so as to shift the 
roots of the characteristic equation to more appropriate locations in the z-plane. 

Consider again the system of Fig. 8-6, which has the characteristic equation 


1 + KD(z)G(z) = 0 (8-67) 


where K is the added gain that is to be varied to generate the root locus. Then a point z, is on the 
root locus provided that (8-67) is satisfied for z = z,, or that 


1 


K = TDG] ee 


Z(D(Z,)G(Zq)) = £180° (8-69) 


Since we allow K to vary from zero to infinity, a value of K will always exist such that (8-68) is 

satisfied. Then the condition for a point z, to be on the root locus is simply (8-69). If the sensor 

transfer function H(s) is not unity, G(z) in the foregoing equations is replaced with GH(z). 
Suppose, as an example, that D(z) = 1 and KG(z) is given by 


Z K(z — zı) : 
KG(z) = en Ca (8-70) 


where z1, Z2, and z3 are all real. Figure 8-27 illustrates the testing of point z to determine if it is 
on the root locus. 
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FIGURE 8-27 Point on the root locus. 


If z is on the root locus, then, from (8-69), 
0, — ð — 6; = +180° 


The value of K that places a root of the characteristic equation at this point is, from (8-68), 


K= [z= zllz =z 
Iz = zl 


With this brief discussion of the root locus, we will now consider design procedures. 
Consider the first-order controller 


K —, 
D) = At 2 (8-71) 
p 


We will require that the filter dc gain equal unity (D(1) = 1) so as not to affect the steady-state 
response; hence 


l= z 


Kı = (8-72) 
1- Zo 

In this design, the gain K is utilized to meet steady-state error requirements. The controller pole 

is restricted to real values inside the unit circle. For a phase-lead controller zọ > zp, and thus 


Kı > 1. Fora phase-lag controller 7 < z,and Ky < 1. 


PHASE-LAG DESIGN. We will first consider phase-lag design. We will illustrate the design for 
the plant, G(z), of (8-70). The uncompensated root locus is sketched in Fig. 8-28(a). Suppose that 
the root locations z, and Z, give a satisfactory transient response, but that the loop gain K must 
be increased to produce smaller steady-state errors, improved disturbance rejection, and so on. 
We add the controller pole and zero as shown in Fig. 8-28(b), assuming that z3 = 1. If z3 # 1 
, the controller pole and zero are placed close to z = 1. Since the pole and zero are very close 
toz = 1 (recall Example 8.1), the scale in the vicinity of this point is greatly expanded. Hence 
these two poles and one zero will essentially appear as a single pole as in Fig. 8-28(a), when 
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(b) 


FIGURE 8-28 Phase-lag design. 


determining the root location at z,. We see, then, that the compensator pole and zero cause the 
root at z, to shift only slightly to z}, that is, z} ~ z, However, 


K.KaZ — 2%) — zı) 
E — ZZ = ZZ — z3) 


K.D(2)G@) = 


where K, is the gain in the compensated system. Hence, for a root to appear at z/,, from (8-68), 


_ lea ~ Sllza ellea-al la alla zl 


7 7 E (8-73) 
Kalza — zollza — zıl Kalza = zıl 


Let K, be the gain required to place the root at z, in the uncompensated system, as shown in 
Fig. 8-28(a). Then 


[za = zl lza = zl 


K, = (8-74) 


[zz E zl 


Hence, from (8-73) and (8-74), 
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Now, K, is the gain for the uncompensated system, and Ky < 1 since the controller is phase lag. 
Hence the gain for the compensated system, K,, is greater than that for the uncompensated sys- 
tem, K,. So we see that phase-lag compensation allows us to increase the open-loop gain while 
maintaining the approximate same roots in the characteristic equation. Of course, as seen from 
Fig. 8-28(b), we have added a root close to z = 1, which has a long time constant. Thus the sys- 
tem will have an increased settling time. 

The root-locus phase-lag design procedure is then as follows: 


= 


. Choose the desired root location z, and find K,, the gain required to place the root at z, in 
the uncompensated system. 

. Determine from the design specifications the required compensated-system gain K,. 

. The compensator gain K, is calculated from K, = K,/K,. 

. Choose the compensator pole z, sufficiently close to z = 1 such that (8-73) is satisfied. 

. From (8-72), the compensator zero is given by 


nb WN 


1-% 
Ky 


æ=1- (8-75) 


From (8-73), this procedure is only approximate. 


EXAMPLE 8.7 


Consider the system of Fig. 8-29, with T = 1 s and 


oy = T E 
p) = GED @ = z- DE- 0.368) 


The root locus for the uncompensated system is illustrated in Fig. 8-28(a), with 
zı = —0.718, z = 0.368, and z3 = 1. To find z, and K,, use MATLAB to generate the root 
locus of the uncompensated system. For our design, choose z, to be the point of critical damp- 
ing. The following MATLAB code generates the needed root-locus plot displayed in Fig. 30(a): 


>> T = 1; Gp=tf([1], [1 1 0]), Gz=c2d(Gp,T) 
rlocus(Gz), axis([0 1 -0.5 0.5]), grid 


This system is shown to be critically damped with two poles at z = 0.648 for K = 0.196. We 
will design a phase-lag compensator that results in critically damping with two poles atz ~ 0.65 
with K = 0.8. Hence the steady-state errors are reduced by a factor of approximately 4. From 
the design procedure: 


1. K, = 0.196 and z, = 0.648. 
2. K, = 0.8. 


Rs) + 


FIGURE 8-29 System for Examples 8.7 and 8.8. 
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0.5 


05%/T 


System Gz 
Gain : 0.196 

Pole: 0.648 — 8.62e — 09i 
Damping: 1 

|_| Overshoot (%): 1 
Frequency (rad/s): 0.434 


Imaginary Axis 


(a) 


System Gz 

Gain : 0.808 

Pole: 0.649 — 0.00148: 
Damping: | 

|_| Overshoot (%): 1 
Frequency (rad/s): 0.432 


Imaginary Axis 


OSpIT a ~~ 03 of aT 
1 L fi s ade ar 


0.1 ; g 0.6 07 
Real Axis 
(b) 
FIGURE 8-30 Root-locus plots for Example 8.7. Source: Reprinted with permission from 
The MathWorks, Inc. 
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3. k = = — = 0.245 
4. Letz, = 0.9990, a somewhat arbitrary choice. 
5. a% =1- 1 -= 2 = 0.9959 
Thus 
DO = 0.245(z — 0.9959) _ 0.245z — 0.2440 


z — 0.999 z — 0.999 


Figure 8-30(b) shows the compensated root-locus plot. The plot gives two poles at 
z = 0.649 for K = 0.808. A more accurate value is 0.80781. The pole location is very sensitive 
to small gain changes. The closed-loop third pole is at z ~ 0.9959 (see Figs. 8-28(b)). Closed- 
loop performance metrics for this design include gain margin, 19.8 dB; phase margin, 69 .1°; rise 
time, 7.0 s; settling time, 12.0 s; and overshoot, 1.46%. A MATLAB program to perform the 
computations is now given. 


>> T = 1; Gp=tf([1],[1 1 0]); Gz=c2d(Gp,T) ; 
Gz=zpk (Gz) 

% Get Kc and za from system specifications 
Ke = 0.8 % At critical damping 

% Uncompensated Root Locus 

rlocus(Gz), axis([0 1 -0.5 0.5]), grid 

% Get Ku from rlocus and calculate Kd = Ku/Ke 
Ku = 0.196 

Kd = Ku/Ke 

% Set zp=0.999 and calculate z0=1-(1-zp)/Kd 
zp=0.9990 

z0=1- (1-zp) /Kd 

% Find D(z) 

Dz=zpk (z0, zp, Kd,T) 

DzGz=Dz*Gz 


rlocus(DzGz,'-k'), axis([0 1 -0.5 0.5]), grid 
% Root-locus near z = 0.995 
% rlocus(DzGz,'-k'), axis([0.99 1.001 -0.00025 0.00025]), grid 


% Set Kc to designed compensated system critical gain 
% Closed-loop poles and zeroes 

format long 

Ke = 0.807813075 

format short 

Cz=feedback (Kc*DzGz,1); Cz=zpk (Cz) 

disp('Gain and Phase Margin:') 

[Gm, Pm] = margin(DzGz); GmdB = 20*logl0(Gm), Pm 
disp('Unit-step performance metrics:') 
Cz_stepinfo=stepinfo (Cz) 


PHASE-LEAD DESIGN. Phase-lead design is illustrated in Fig. 8-31. Here, to simplify the dis- 
cussion, we place the controller zero coincident with the plant pole at z = z2. The controller 
pole is placed to the left of the zero, which yields the phase-lead controller. Thus the root locus 
is shifted to the left. The resulting root at z, has a smaller time constant than that at z,; thus the 
system responds faster (larger bandwidth). 
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(b) 
FIGURE 8-31 Phase-lead design. 


A phase-lead design procedure is as follows: 


p 


Choose the desired root location z+. 
Choose the compensator zero zo to cancel a pole of G(z). 


Choose either the gain K, of the compensated system or the location of the compensator 
pole z, < Zo, such that the compensator is phase lead. 
4. Then, from (8-67), 


pa 


K.D(Z)GZp) = —1 (8-76) 


Solve for the unknown, which is either K, or z,. The pole z, appears twice in (8-76), as 
seen from (8-71) and (8-72). 

Note that this design procedure sets only one root of the characteristic equation; the loca- 
tions of the other roots may not be satisfactory. Hence iterations of steps 3 and 4 may be required. 
As in the case of frequency-response design, phase-lead design tends to be by trial and error. 
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As a practical consideration, exact pole-zero cancellation cannot occur. Hence, we actually 
have two different cases. The first case is illustrated in Fig. 8-31(b), where the compensator zero 
is to the left of the plant pole to be canceled. For this case, the closed-loop transfer function will 
have an additional pole slightly to the left of the compensator zero. For the second case, the com- 
pensator zero is to the right of the plant pole, as illustrated in Fig. 8-31(c). The closed-loop trans- 
fer function will then have an additional pole slightly to the right of the compensator zero. In 
either case, the amplitude of the transient-response term associated with this added closed-loop 
pole, as excited by the input, will be small, since the closed-loop transfer function has a zero 
(from the compensator) that is almost coincident with the pole. 

In summary, the phase-lag controller shifts the root locus very little, but allows a higher 
open-loop gain to be used. Or if the same open-loop gain is used, the system is more stable. The 
phase-lead controller shifts the root locus to the left, resulting in a system that responds faster. 
A phase-lead example will now be given. 


EXAMPLE 8.8 


Phase-lead design by trial and error will be illustrated in this example. Consider the system in 
Fig. 8-29. Suppose that the plant transfer function is given by 


1 
G,(s) = ———~ 
DO ee Ay 
Since the time constant of the pole at s = —1 is 1 s, we choose T = 0.1 s. Then 
z= 1 1 
Gz) = | | 
@) Zz é (5 + 1) 


_ 0.004837(z + 0.9672) 
(z — 1)(z — 0.9048) 


The root locus for G(z) is shown in Fig. 8-32(a). Now we follow the four design steps: 


1. Choose the desired root location z,. Note for the uncompensated system that K is equal 
to 0.244 for critical damping, with the two roots coincident at z = 0.952. We will 
design a critically damped compensated system, so z, will lie on the real axis and be less 
than 0.952. 

2. Choose the compensator zero Zp to cancel a pole of G(z). We choose the pole at 0.9048. 

3. Choose either gain K, or the location of compensator pole z,. In our case, we will try a 
pole location of 0.7 (which is less than our zp choice as required). Since D(z) must be unity 
gain, 

l=% 1-0.7 


Kı = = = 3.15 
4 1-z% 10.9048 


Ka — zo) _ 3.15(z — 0.9048) 
27 Zp z— 0.7 


D(z) = 


4. We can find z, = 0.844 and K, = 0.814 from the compensated root locus which is 
plotted in Fig. 8-32(b). We can check the results using (8-76) 
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T Sn ( zæ — 0.7 \( (zm — Dp - se 
© DZ;)G(Zp) 3.15(z, — 0.9048) /\0.004837(z, + 0.9672) 


_ (2 = o1) -1 ) 
3.15 /\0.004837(z, + 0.9672) 


In this example, we choose the design of a critically damped system, so there are two closed-loop 


= 0.8136 
zp=0.844 


poles on the real axis. A pole in the s-plane at s = —a has a time constant of t = 1/a and an 
equivalent z-plane location £ “7 = e¢”". Thus, for the uncompensated critically damped case, 
e Ol" = 0.952 


Imaginary axis 


-f| Damping: 1 
P ---] Overshoot (%): 0 
is Frequency (rad/s): 0.494 


0.85 0.9 0.95 
Real axis 
(a) 
FIGURE 8-32 Root locus for Example 8.8. Source: Reprinted with permission from The MathWorks, Inc. 
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FIGURE 8-32 (Continued) 


ort = 2.03 s. For the compensated critically damped case, 
g r= 0.844 


or T = 0.59 s. Thus the compensated system should respond about 3.4 times faster. Plots of 
the step responses for both the uncompensated system and the compensated system are shown 
in Fig. 8-33. The step performance metrics for the uncompensated system are rise time, 6.80 s; 
settling time, 11.90 s; and overshoot, 0%. The parameters for the compensated system are rise 
time, 1.90 s; settling time, 3.50 s; and overshoot, 0%. Note that the rise and settling times for the 
compensated system are indeed about 3.4 times faster. 

A MATLAB program for this example follows. 

>> Gp=tf£([1],[1 1 0]); T = 0.1; Gz=c2d(Gp,T); Gz=zpk (Gz) 

% Uncompensated rlocus 
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FIGURE 8-33 Step responses for Example 8.8. 


2 


% Plot Figure 8-32a 

figure(1), rlocus (Gz), axis([0.85 1 -0.5 0.5]), grid 
% Critical damping at Ku=0.244 with za = 0.952 

% Choose zb as critically-damped compensated poles 

% Choose z0 to cancel the Gp pole at 0.9048 

Ku = 0.244, z0 = 0.9048 

% Try the compensator at 0.7 


zp = 0.7 
% Find D(z) 
Kd = (1-zp)/(1-z0) 


Dz = zpk(z0,zp,Kd,T) 

% Find Kc and zb from the compensated rlocus 

DzGz=Dz*Gz 

% Plot Figure 8-32b 

figure(2), rlocus(DzGz), axis([.6 1.02 -0.8 0.8]), grid 
% At Kc = 0.814, zb = 0.844 

% Check results using equation (8-76) 

zb = 0.844 

Ke = -(zb-0.7)*(zb-1)/0.015244/ (zb+0.9672) 
Cz_uncomp=feedback (Ku*Gz,1); Cz _comp=feedback (Kc*DzGz,1) ; 
% Plot Figure 8-33 

figure(3), step(Cz_uncomp, '-k!',Cz_comp,'-k',10), grid 
disp('Unit-step performance metrics:') 
Cz_uncomp_info=stepinfo(Cz_uncomp), Cz_comp_info=stepinfo(Cz_comp) 


A point must be made concerning the last example. It appears that we can increase the speed 
of response of this system by a very large factor, simply by moving the pole of the controller to the 
left. However, this movement of the pole increases the high-frequency gain of the controller, and this 
increase may not be acceptable. To illustrate this point, suppose that the plant in Fig. 8-29 is a servo- 
motor, and the gain K is a power amplifier that drives the motor. For the uncompensated system with 
a unit-step input, the maximum error is 1, which appears at t = 0 as shown in Fig. 8-33. Since the 
amplifier gain K = 0.244, the maximum amplifier output is 0.244. For the compensated system, 
the maximum error is also 1, at £ = 0. At this instant, the controller output is 3.15 (the interested 
reader can prove this). Hence, since the amplifier gain is 0.814, the amplifier output is 2.56, which 
is an increase by more than a factor of 10 over that of the uncompensated system. This increase 
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in motor voltage accounts for the faster response. However, the larger voltages generated by the 
phase-lead compensation may force the system into nonlinear regions of operation. A discussion of 
the possible effects of this operation is beyond the scope of this book; however, in nonlinear regions 
of operation the results of the linear analysis given above will no longer be applicable. 

As a last example in this chapter, let us return to the system of Example 8-1. For this 
example, we will first use root locus to design a critically-damped lead controller, then increase 
the open-loop gain appropriately to achieve a phase margin of approximately 55°. 


EXAMPLE 8.9 


We can use the MATLAB program of Example 8.8 to compute the parameters for this controller. 
First we examine the discrete open-loop transfer function G(z) 


4.014 X 10 >(z + 3.595)(z + 0.258) 


OO) = 1g — 09512 — 0.9048) 


and determine that we can use the controller zero to cancel the discrete plant pole at 0.9512. 
If we again assume that the controller pole will arbitrarily be 0.7, the controller gain must be 
K, = 6.148 to make D(1) = 1. Next, we plot the root locus for D(z)G(z). From that plot, 
a closed-loop gain K, = 0.42 would make the controlled system critically damped with 
closed-loop roots at 0.957 and no overshoot. However, in this case we want to increase K, to 
make the system respond faster, allowing some overshoot to take place. By trial and error, we 
can increase the gain by a factor of 2.57 yielding the final controller as 


= (2.57)(0.42)(6.148)(z — 0.9512) 7 6.64(z — 0.9512) 
(z — 0.7) (z — 0.7) 


D(z) 


This controller achieves a phase margin of 55.1°; margin, 16.7 dB, rise time, 1.2 s; settling time, 
4.2 s, and overshoot, 12.9%. Using (6-21), the steady-state unit ramp error is 0.916. 

Trial-and-error design as performed above may also be accomplished using MATLAB’s 
sisotool. To use sisotool, first create G(z) in the MATLAB Workspace, then launch the tool and 
import the plant model into System Data. 


>> Gp = tf£([2],[1 3 2 0]); Gz = c2d(Gp,.05); Gz=zpk (Gz) 
sisotool 


Next go to the Compensation Editor and Add Pole/Zero. The choices offered are Real Pole, 
Complex Pole, Integrator, Real Zero, Complex Zero, Differentiator, Lead, Lag, and Notch. For this 
example, select the Lead option. The sisotool then places a real zero at 0.95123 and a real pole at 
0.60653 with a damping factor of 1.0 and dc gain of 1.0. Change the real zero to 0.9512 and the real 
pole to 0.70 (as was designed above) and adjust the compensator gain to achieve a 55° phase mar- 
gin. This may be done by trying various values for the dc filter gain in the Control and Estimation 
Tools Manager window as shown in Fig. 8-34 (change 1.0 to 1.08), or by adjusting the dc filter gain 
in the open-loop Bode plot in the SISO Design Task window as shown in Figure 8-35 (click on the 
square marker and raise the curve to reduce the gain margin to 16.7 dB). The resulting filter gain is 


Wiese ¢ 1 — 0.70 
Kt == 1.08( = 6.64 
1-— z 1 — 0.9512 


which is the value obtained above. 
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FIGURE 8-34 MATLAB sisotoo/ Control and Estimation Manager window. Source: Reprinted with 
permission from The MathWorks, Inc. 
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FIGURE 8-35 MATLAB sisotoo! SISO Design Task window. Source: Reprinted with permission from 
The MathWorks, Inc. 
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TABLE 8-3 Comparison of Performance Parameters for Examples 8.1 - 8.6 and 8.9 


Gain Phase Over- 
Design margin margin Risetime Settling shoot Ramp 
type Controller D(z) (dB) (deg) (s) time (s) (%) error 
8.1 lag 0.389(z — 0.9982) 16.8 55.9 3.15 32.4 14.1 1.00 
z — 0.9993 
8.2 lead 6.528(z — 0.9711) 12.4 55.0 1.05 5.2 11.4 1.00 
z — 0.8111 
8.3 5.227(z — 0.9982)(z — 0.9792) 11.2 55.0 1.05 5.3 10.7 0.50 
lag-lead (z — 0.9993)(z — 0.8604) 
8.4 PI 0.4393(z — 0.99954) 16.0 55.0 2.95 19.4 13.8 0 
eae | 
8.5 PID  28.52(z — 0.99986)(z — 0.9504) 23.3 55.0 1.05 3.6 13.0 0 
az — 1) 
8.6 14.37(z — 0.9995)(z — 0.9569) 17.8 55.0 1.0 3.45 12.9 0 
pidtool (z — 1X(z — 0.5221) 
8.9 6.64(z — 0.9512) 16.7 55.1 1.25 4.25 12.6 0.98 
sisotool z— 0.7 


In this chapter, seven different controllers were designed designed for this system. A sum- 
mary of the performance parameters for each of those designs is provided in Table 8-3. 


8.12 SUMMARY 


Various criteria used in the specification of control systems are presented in this chapter. Next, 
digital controller design techniques using phase-lead and phase-lag compensation are devel- 
oped. These techniques, based on frequency responses, tend to be largely trial and error, but are 
among the more commonly used techniques in compensator design. Then the three-term control- 
ler (PID) is developed, and is seen to be a special type of lag-lead design. Next, the MATLAB 
pidtool is illustrated in an example. Finally, design by root-locus techniques is developed and the 


MATLAB sisotool is introduced. 
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Problems 


8.2-1. Consider the second-order analog system described by 


w- 2 gy = 
= Te GY AS) = E + Ko) 


where T(s) is the closed-loop transfer function and G,(s) is the plant transfer function. Show that the phase 
margin ,, and the damping ratio ¢ are related by ,, ~ 100¢ by sketching this relationship onto Fig. 8-2. 
8.2-2. Consider the system of Fig. P8.2-2 with T = 0.2. 


(a) Show that the pulse transfer function of the plant is given by 


Z=] | 1 | _ 0.01873z + 0.01752 
G@ = — 4- 
z s(s + 1) z— 1)(z — 0.8187) 
(b) The frequency response for G(z) is given in Table P8.2-2. From this frequency response, sketch the 
Bode and the Nyquist diagrams for the uncompensated system, indicating the gain and phase margins. 
(c) Calculate the value of G(jw,,) as w,, — ©. It is not necessary to find G(w) to calculate this value. 
(d) Use the results of part (b) to estimate the overshoot in the unit-step response. 
(e) Based on the results in part (d), are the zeros of the uncompensated system characteristic equation real 
or complex? Why? 
(f) Use MATLAB to find the rise time ¢,. The step response will show a 21 percent overshoot. 


im(t) j C(s) 
i | 


FIGURE P8.2-2 System for Problem 8.2-2. 


TABLE P8.2-2 Frequency Response for PROBLEM 8.2-2 


Wy o [Gon] — |GGe,)| as ZG(joy) 
0.1 0.100 9.95054 19.95 —96.28 
0.2 0.200 4.90325 13.80 —102.45 
0.3 0.299 3.19331 10.08 —108.41 
0.4 0.399 2.32198 7.31 —114.08 
0.5 0.499 1.78990 5.05 —119.40 
0.6 0.599 1.43046 3.10 —124.36 
0.7 0.698 1.17191 1.37 —128.95 


0.8 0.798 0.97794 —0.19 =133.17 
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TABLE P8.2-2 Continued 


Mp IGGe,)| [Gola 2G) 
0.9 0.897 0.82799 —1.63 —137.05 
1.0 0.996 0.70945 —2.98 —140.61 
2.0 1.974 0.22743 —12.86 —164.43 
3.0 2.914 0.10973 —19.19 —177.74 
4.0 3.805 0.06511 —23.72 —187.04 
5.0 4.636 0.04372 —27.18 —194.33 
6.0 5.404 0.03186 —29.93 —200.38 
7.0 6.107 0.02459 —32.18 —205.55 
8.0 6.747 0.01980 —34.06 —210.03 
9.0 7.328 0.01646 —35.67 —213.95 

10.0 7.854 0.01403 —37.05 —217.40 

20.0 11.071 0.00558 —45.07 —236.77 

30.0 12.490 0.00352 —49.07 —243.95 

40.0 13.258 0.00259 —51.73 —246.94 


Consider the system of Problem 8.2-2. It is desired that the steady-state error constant for a unit-ramp 

input, K, of (6-20), be 4, resulting in a steady-state error of 0.25. 

(a) Repeat Problem 8.2-2(a), (b), (c), and (d) for this system. 

(b) Use the phase margin ¢,, and Fig. 8-2 to estimate the characteristics C, M,, and M,. 

(c) Verify the value of M, in part (b) using MATLAB. The step response will show that M, ~ 1.62. 

Consider the system of Problem 8.2-2. The plant frequency response G(jw,,) is given in Table P8.2-2. 

(a) Let the digital controller realize a gain K, that is, D(z) = K. Find K such that the system phase margin is 45°. 

(b) Obtain the system step response of part (a) using MATLAB, and find the rise time f, and the percent 
overshoot. 

Consider the system of Fig. P8.2-2 with T = 1 s. The plant frequency response G(jw,,) is given in 

Table P8.4-1. 

(a) Let D(z) = 1. If the system is stable, find its phase margin. 

(b) Let the digital controller realize a gain K, that is, D(z) = K. Find K such that the system phase margin 
is 45°. 

(c) Obtain the system step response of part (b) using MATLAB, and find the rise time ¢,, and the percent 
overshoot. 

(d) Design a unity-dc-gain phase-lag compensator that yields a phase margin of approximately 45°. 

(e) Obtain the system step response of part (d) using MATLAB, and find the rise time ¢,, and the percent 
overshoot. 


TABLE P8.4-1 Frequency Response for PROBLEM 8.4-1 


My, w [GUo,)| [Gola LCG) 
0.1 0.099 9.95473 19.96 —98.56 
0.2 0.199 4.91192 13.82 —106.98 
0.3 0.297 3.20693 10.12 —115.10 


0.4 0.394 2.34103 7.38 —122.83 


TABLE P8.4-1 Continued 


Oy a |G(je,,) | [Gola LCG) 
0.5 0.490 1.81474 5.17 —130.10 
0.6 0.582 1.46124 3.29 —136.87 
0.7 0.673 1.20853 1.64 —143.14 
0.8 0.761 1.02011 0.17 —148.92 
0.9 0.845 0.87530 —1.15 —154.24 
1.0 0.927 0.76140 —2.36 —159.13 
2.0 1.570 0.30058 —10.44 —190.88 
3.0 1.965 0.18220 —14.78 —205.37 
4.0 2.214 0.13244 —17.55 —212.26 
5.0 2.380 0.10579 —19.51 —215.43 
6.0 2.498 0.08942 —20.97 —216.61 
7.0 2.585 0.07848 —22.10 —216.68 
8.0 2.651 0.07073 —23.00 —216.11 
9.0 2.704 0.06502 —23.73 —215.18 

10.0 2.746 0.06068 —24.33 —214.06 

20.0 2.942 0.04455 —27.02 —203.02 

30.0 3.008 0.04097 —27.75 —196.54 

40.0 3.041 0.03964 —28.03 —192.77 


8.4-2. To satisfy the steady-state constraints for the system of Problem 8.2-3, 


must be equal 4. 


Problems 


(a) Design a phase-lag controller with this de gain that will result in a 45° phase margin. 
(b) Estimate the percentage of overshoot in the step response of the compensated system. 
(c) Verify the step-response results in part (b) using MATLAB. The step response will show an overshoot 


in the step response of approximately 24 percent. 
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the dc gain of the digital controller 


8.4-3. Shown in Fig. P8.4-3 is the block diagram of the temperature control system described in Problem 1.6-1. 
For this problem, ignore the disturbance input. In Fig. P8.4-3 the sensor gain of H = 0.04 has been shifted 
into the forward path to yield a unity feedback system. The stability characteristics are unchanged, since 
the loop transfer function has not changed. Note that c(f) is the chamber temperature in degrees Celsius. It 
is shown in Problem 6.2-4 that with T = 0.6, the function G(z)H is given by 


R(s) + E(s) 


Disturbance M 2 
R45) s+0.5 
G,(s) H 
i= 2 + 
DE) £ >= >| 0.04 
s s+0.5 | C(s) 


FIGURE P8.4-3 Modified temperature control system. 
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TABLE P8.4-3 Frequency Response for PROBLEM 8.4-3 


Ow W% |G(jo,) | |G(jw,,) | ap LGG) 
0.1 0.100 3.92295 11.87 —13.11 
0.2 0.199 3.71673 11.40 —25.38 
0.3 0.299 3.43700 10.72 —36.29 
0.4 0.398 3.13670 9.92 —45.71 
0.5 0.496 2.84938 9.09 —53.74 
0.6 0.593 2.59043 8.26 —60.60 
0.7 0.690 2.36393 7.47 —66.52 
0.8 0.785 2.16851 6.72 —71.68 
0.9 0.879 2.00067 6.02 —76.23 
1.0 0.971 1.85649 5.37. —80.30 
2.0 1.801 1.12345 1.01 —107.02 
3.0 2.442 0.87830 —1.12 —122.59 
4.0 2.920 0.76932 —2.27 —133.12 
5.0 3.276 0.71225 —2.94 —140.64 
6.0 3.545 0.67895 —3.36 —146.21 
7.0 3.754 0.65796 —3.63 —150.48 
8.0 3.920 0.64393 =3.82 —153.83 
9.0 4.053 0.63411 —3.95 —156.52 

10.0 4.163 0.62698 —4.05 —158.72 

20.0 4.685 0.60357 —4.38 —169.11 

30.0 4.867 0.59912 —4.44 —172.71 

40.0 4.958 0.59756 —4,47 —174.52 


é 0.04) 221 | 2 | 0.04147 
OT E eR 

The frequency response for G(z) is given in Table P8.4-3. The sensor gain H = 0.04 is not included in 

this table. 

(a) Calculate the dc gains of both the forward path and the closed-loop system, with D(z) = 1. 

(b) Find the steady-state error e,,(kT) for a unit step input using (6-19). Express this error in percent. 

(c) Let D(z) = K, a pure gain. Find K such that the steady-state error in part (b) is 0.05, or 5 percent. 
Assume that the resulting system is stable. 

(d) It was shown in Problem 7.5-3 that the system is unstable for K > 41.96. Can the system in part (c) be 
implemented to yield a 5 percent steady-state error? Explain your answer. 

(e) Design a phase-lag compensator with a de gain of 118.8 to yield a phase margin of 45°. 

(£) What is the percent steady-state error for a constant input for the system in part (e)? 

(g) Simulate the system of part (e) using MATLAB to show that the steady-state error is 5 percent. 

This problem is based on the solution in Problem 8.4-3. Suppose that in Fig. P8.4-3, the sensor gain 

H = 0.04 is moved back to the feedback path. What effect does this have on the percent steady-state error 

of Problem 8.4-3, where this error is defined as 


8.6-1. 


8.6-2. 
8.6-3. 


8.6-4. 
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commanded output — actual output 
steady-state error = x 100 
commanded output 


Note that this result allows us to convert a nonunity feedback gain system to a unity-gain feedback system, 

without affecting the percentage steady-state error. 

Consider the system of Problem 8.4-1. 

(a) Design a unity-dc-gain phase-lead compensator that yields a phase margin of approximately 45°. 

(b) Obtain the system step response of part (a) using MATLAB, and find the rise time ¢, and the percent 
overshoot. 

(c) Compare the step-response parameters of part (b) with Problem 8-2(c) and (e). 

Repeat Problem 8.4-2 using a phase-lead controller. In part (c), the overshoot is approximately 26 percent. 

Three constraints are given on the choice of the phase-margin frequency, w,,;, in Section 8.6 for phase-lead 

design. Derive the three equivalent constraints on w,,; for the design of phase-lag controllers using (8-33). 

Consider the block diagram of a robot-arm control system shown in Fig. P8.6-4. This system is described 

in Problem 1.5-4. Let T = 0.1. It was shown in Problem 4.3-8 that 


z=1 1 0.01873z + 0.0175 
G(z) = | | z 


z ss + 2) (z — 1)(z — 0.818) 


The frequency response for G(z) is given in Table P7-23. Note that the sensor gain H = 0.05 is not 

included in this table. 

(a) Find the system phase margin with D(z) = 1. 

(b) Design a phase-lag controller with the dc gain of 10 that yields a system phase margin of 45°. 

(c) Design a phase-lead controller with the de gain of 10 that yields a system phase margin of 45°. 

(d) Using MATLAB, find the step response for the systems of parts (b) and (c), with 6,(f) = 0.05u(¢). 
Compare the rise times and the percent overshoot for the two systems. The percent overshoot is defined as 

maximum value — final value 


percent overshoot = À x 100 
final value 


Power 
Controller amplifer Servomotor Gears 


9. + Zero-order Ea 200 9m 1 94 


— D(z) | a K S| — 


hold s (0.5s+1) 


FIGURE P8.6-4 Robot arm joint control system. 


8.6-5. 


Consider the block diagram of an antenna control system shown in Fig. P8.6-5. This system is described in 
Section 1.5. Let T = 0.05 and the sensor gain be unity (H = 1). It was shown in Problem 7.5-5 that 
z-1 | 20 | _ 0.02268z + 0.02052 

As] @— DE — 0.7408) 


Giz) = 
z 


The frequency response for G(z) is given in Table P7-24. 


340 


Chapter 8 ° Digital Controller Design 


(a) 
(b) 


(c) 
(d) 


Find the system phase margin with K = 1 and D(z) = 1. 

To reduce steady-state errors, K is increased to 5. Design a unity-dc-gain phase-lag controller that 
yields a system phase margin of 45°. 

Design a unity-dce-gain phase-lead controller, with K = 5, that yields a system phase margin of 45°. 
Using MATLAB, find the unit step response for the systems of parts (b) and (c). Compare the rise times 
and the percent overshoot for the two systems. 


SoS SSeS SSS SS SSeS aa 


Computer 


Motor, 
Digital | gears, and 
' controller | Amplifier pedestal 
RGO) 4 Mo) 20 06) 
l >| D(z) =| DIA >= K 7 
1 r(k) l s^ + 6s O) 
i i 
i} 1 
Ne ee ee ee ee gs = i 
— ame 


li 
1 i 
i i 
A nee rT | 
Binary data l I 


FIGURE P8.6-5 Block diagram for an antenna control system. 


8.6-6. Consider the block diagram of a satellite control system shown in Fig. P8.6-6. This system is described in 
Problem 1.4-1. Let T = 0.1 s, K = 1,J = 0.1, and H, = 0.02. It was shown in Problem 7.5-6 that 


R(s) 
r(t) 


Th 


_z-1 [10] _ 0.05 +1) 
G(z) z | 2] Q- I 


e frequency response of G(z) is given in Table P7-25. Note that the gain H,=0.02 is not included in this 


table. 


(a) 
(b) 


(c) 


(d) 


Sketch the complete Nyquist diagram for D(z) = 1. Is this system stable? 

This system cannot be stabilized by any type of phase-lag controller. Why? Hint: Consider the Nyquist 
criterion and the Nyquist diagram in part (a). 

Design a unity-dc-gain phase-lead controller that yields a system phase margin of 45°. Hint: Use 
Owl = 1. 

Using MATLAB, find the unit step response for the system of part (c). Find the rise time and the per- 
cent overshoot for this system. 


Digital Amplifier and 
controller thrusters Satellite 
+ Mos) T(s) 1 O(s) 
AID (> D(z) m DIA c K >| 7 > 
Torque Js (E) 
Sensor 


H, l< 


FIGURE P8.6-6 Block diagram for a satellite control system. 
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8.10-1. 
8.10-2. 
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8.10-4. 


8.10-5. 


8.10-6. 


8.10-7. 
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8.10-9. 


8.10-10. 
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Design a lag-lead compensator for the system of Problem 8.4-1. Note that G,(s) = Is? + s),T=1s, 

and H = 1. 

(a) Use the lag compensator of Problem 8.4-1 and decrease its gain by a factor of 3. 

(b) Design a cascaded lead compensator for a target phase margin of 55 degrees for the lag-lead combina- 
tion. Why might this be hard to achieve? 

(c) Plot the step responses for this system for the lag compensator of Problem 8.4-1, the lead compensator 
of 8.6-1, and the lag-lead design of this problem. 

Design a lag-lead compensator for the system of Problem 8.2-2. Note that G,(s) = IMs? + 8), 

T= 0.2s,andH = 1. 

(a) Use the lag compensator of Problem 8.4-2 and increase its gain by a factor of 2. 

(b) Cascade a lead compensator to achieve a phase margin of 60 degrees for the lag-lead combination. 

(c) Plot the step responses for this system for the lag compensator of Problem 8.4-2, the lead compensator 
of 8.6-2, and the lag-lead design of this problem. 

Write the difference equations required for the realization of the PID controller transfer function D(z) in 

(8-52). Let E(z) be the controller input and M(z) be the controller output. 

If the rectangular integrator [see below (8-38)] is used in the PID transfer function in (8-52), the resulting 


controller is described by 
M(z) | Tz | É = 4 
= Dz) = K, + K; + K 
EZ) ( ) p T g= 1 D Tz 


This transfer function is implemented in many commercial digital controllers. Write a difference equation 

required to realize this controller. 

Repeat Problem 8.4-1, using a proportional-plus-integral digital filter. 

Repeat Problem 8.6-1, using a proportional-plus-derivative filter. 

Consider Problem 8.4-2 again. In this problem a proportional-plus-integral (PT) filter is to be designed. 

(a) The gain added in Problem 8.4-6 to reduce steady-state errors is no longer necessary. Why? 

(b) Repeat Problem 8.4-6 using a proportional-plus-integral filter, with the gain of 4 omitted. 

Repeat Problem 8.6-2 using a proportional-plus-derivative (PD) filter. 

Repeat Problem 8.4-3 for a proportional-plus-integral (PI) compensator. Note that in this case, the 

steady-state error for a constant input is zero. 

In this problem we consider the effects of the disturbance input in Fig. P8.4-3. 

(a) Suppose that the disturbance input is a unit step, which models the door to the chamber remaining open. 
Find the steady-state error in the temperature c(t) for the uncompensated system in Problem 8.4-3. 

(b) Repeat part (a) for the phase-lag compensated system in Problem 8.4-3(e). 

(c) Repeat part (a) for the PI-compensated system in Problem 8.10-5. 

(a) Design a PI controller for Problem 8.6-4(b). 

(b) Design a PD controller for Problem 8.6-4(c). 

(c) Use the results of parts (a) and (b) to repeat Problem 8.6-4(d). 

(a) Design a PI controller for Problem 8.6-5(b). 

(b) Design a PD controller for Problem 8.6-5(e). 

(c) Use the results of parts (a) and (b) to repeat Problem 8.6-5(d). 

(a) Repeat Problem 8.6-6(a) and (b). 

(b) Design a PD controller for Problem 8.6-6(c). Hint: Use w,,; = 1. 

(c) Use the results of part (b) to repeat Problem 8.6-6(d). 

Consider the system of Example 8.1. 

(a) Design a PI filter to achieve a phase margin of 60°. 

(b) Obtain the system step response using MATLAB. Compare this response to that of the system of 
Example 8.1, which is plotted in Fig. 8-14. 

Use the MATLAB pidtool to design a PID controller for the system of Problem 8.6-1. Start with these 

parameters, then try to improve the design (G, = Is? + s), T = 1,H = 1, P, = 45, oy; = 1.0). 
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8.11-1. 
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Use the MATLAB pidtool to design a PID controller for the system of Problem 8.6-2. Start with these 

parameters, then try to improve the design (G, = 1s? +s) T= 0.2, H 1, Pa = 45, w1 = 3.0). 

Use the MATLAB pidtool to design a PID controller for the system of Problem 8.6-4. Start with these param- 

eters, then try to improve the design (G, = AI(s* + 2s), H = 0.07, T = 0.1, P, = 45, oy, = 6.0). 

Use the MATLAB pidtool to design a PID controller for the system of Problem 8.6-5. Start with these param- 

eters, then try to improve the design (G, = 20/(s? + 6s), H = 1,T = 0.05, P, = 45, ww, = 20.0). 

Use the MATLAB pidtool to design a PID controller for the system of Problem 8.6-6. Start with these 

parameters, then try to improve the design (G, = 10/ $, H = 0.02,T = 0.1, P, = 45, o,; = 1.0). 

Consider the chamber temperature control system of Problem 8.4-3. Suppose that a variable gain K is 

added to the plant. The pulse transfer function for this system is given in Problem 8.4-3. 

(a) Plot the root locus for this system and find the value of K > 0 for which the system is stable. 

(b) Find the time constant for the system with K = 1. 

(c) Design a phase-lag controller such that the characteristic-equation root is approximately the same as 
that in part (b) but for the gain K = 3. Hint: Choose z, = 0.999. 

(d) Find the steady-state errors for both the uncompensated system of part (b) and the compensated sys- 
tem of part (c). 

(e) By computer, verify the design in part (c) by finding the characteristic-equation roots. 

Consider the chamber temperature control system of Problem 8.4-3. Suppose that a variable gain K is 

added to the plant. The pulse transfer function for this system is given in Problem 8.4-3. 

(a) Plot the root locus for this system, and find the value of K > 0 for which the system is stable. 

(b) Find the time constant for the system with K = 1. 

(c) Assuming the resulting system to be stable, find K such that the steady-state error in the uncompen- 
sated system is 0.05, or 5 percent. Is the resulting system stable? [See part (a).] 

(d) Design a phase-lag controller such that the characteristic-equation root is approximately the same for 
the gain K found in part (c). Hint: Choose z, = 0.99999. 

(e) By computer, verify the design in part (d) by finding the characteristic-equation roots. 

Consider the system of Problem 8.10-10. 

(a) Plot the root locus for this system, and find the value of K > 0 for which the system is stable. 

(b) Find the time constant for the system with K = 1. 

(c) Design a phase-lead controller such that the characteristic-equation root in part (b) moves to yield a 
time constant of 0.5 s for K = 1. 

(d) By computer, verify the design in part (c) yields the correct characteristic-equation zero. 

Consider the system of Fig. P8.2-2 with a gain factor K added to the plant. 

(a) Show that the pulse transfer function is given by 


zal | 1 | _ 0.368(z + 0.717) 
I As +1] @— DE- 0.368) 


Zz 


(b) Sketch the root locus for this system, and find the value of K that results in critical damping, that is, in 
two real and equal roots of the system characteristic equation. 

(c) Find the time constants of the two poles in part (b). 

(d) It is desired that the gain in part (b) be multiplied by 1.8, while the characteristic-equation roots 
remain approximately the same. Design a phase-lag controller that meets these specifications. Hint: 
Use z, = 0.999. 

(e) By computer, verify the characteristic-equation roots in part (d). 

Consider the system of Example 8.7. 

(a) Design a phase-lag compensator such that with K = 0.5, the system is critically damped with roots 
having a time constant of approximately 2.03 s. This time constant is the same as that of the uncom- 
pensated system with K = 0.244. 

(b) By computer, verify the characteristic-equation roots in part (a). 


Pole-Assignment Design and 
State Estimation 


9.1 INTRODUCTION 


In Chapter 8 we considered discrete control design both from a frequency-response point of view 
and from a root-locus point of view. In every case we considered only one signal in the feedback 
loop. It seems reasonable that if we can determine more about the present condition of a system and 
use this additional information to generate the control input, then we should be able to control the 
system in a manner that is, in some sense, better. Of course, we have a complete description of the 
condition of a system if we measure its state vector. Hence we might conclude that if we are able to 
specify mathematically what defines the very best control system, the design of this control system 
might require that we have all the states of the system available for feedback. Generally, the design 
of systems of this type does require that we assume that the full-state vector is available for feedback. 

For most control systems the measurement of the full-state vector is impractical. To imple- 
ment a design based on full-state feedback, we must estimate the states of a system using measure- 
ments that are practical. The state estimation is accomplished by designing a dynamic system (a set 
of equations) for the computer that estimates the states using all information available. Fortunately, 
we can separate the design into two phases. During the first phase, we design the system as though 
all states of the system will be measured. The second phase is then the design of the state estimator. 
In this chapter we consider both phases of the design process and the effects that the state estimator 
has on closed-loop system operation. Then, in Chapter 11, after the introduction of the appropriate 
mathematics, we consider the Kalman filter, which is an optimal state estimator. 


9.2 POLE ASSIGNMENT 


In this section a design procedure generally known as pole assignment, or pole placement, is 
developed. The design results in the assignment of the poles of the closed-loop transfer function 
(zeros of the characteristic equation) to any desired locations. There are, of course, practical 
implications that will be discussed as the technique is developed. 
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FIGURE 9-1 Servomotor system. 


U(s) 


To introduce the pole-assignment technique, we will consider the model of a servomotor, 
developed in Chapter 1. This model is second-order, and an example is shown in Fig. 9-1. The 
state model for this system was calculated following the procedure used in Example 4.13 and is 
given by 

hie | 1 onary k P poeri 
0 0.904837 0.095163 


yk) = O}x(k) 


Jue 
(9-1) 


In this model x(k) is the position (angle) of the motor shaft, which can easily be measured. The 
state x2(k) is shaft velocity, which can be measured using a tachometer or some other suitable 
sensor. Thus for this system the full-state vector can be measured. 

We choose the control input u(k) to be a linear combination of the states; that is, 


ulk) = —Kyx\(k) — Koxx(k) = —Kx(k) (9-2) 


where the gain matrix K is 


K = [k,_ kj] 


Then (9-1) can be written as 


| 1 | hae 
x(k + 1) = x(k) — 
0 0.904837 0.095163 


[ikw + Kx(k)] 

(9-3) 
7 i — 0.0048374K, 0.095163 — oe | 
~ | — 0.095163K; 0.904837 — 0.095163 K, || x(k) 


The matrix of (9-3) is the closed-loop system matrix, which we will call Ay. The closed-loop 
system equation is then 


x(k + 1) = Apx(k) (9-4) 
and the characteristic equation is 
a(z) = |z — A,| = 0 (9-5) 


Evaluation of (9-5) yields, after some calculations (see the MATLAB program below), the char- 
acteristic equation 
z? + (0.0048374K, + 0.095163K, — 1.904837)z + 


0.0046788K, — 0.095163K, + 0.904837 = 0 (9-6) 


9.2 Pole Assignment 


Suppose that, by some process, we choose the desired characteristic-equation zero loca- 
tions to be à; and \,. Then the desired characteristic polynomial, denoted a(z), is given by 


(Zz) = (Z — AMZ — Ag) = Z — Cy + Ag)z + Apo (9-7) 


Equating coefficients in (9-6) and (9-7) yields the equations 


0.0048374K, + 0.095163K, = —(A, + M) + 1.904837 


(9-8) 
0.0046788K, — 0.095163K, = d,A2 — 0.904837 
These equations are linear in K, and Ky, and upon solving yield 
Kı = 105.0833[\jAy — (Ay + Ag) + 1.0] 
(9-9) 


Ky = 14.67494 — 5.34172 ħħ — 5.16661( A, + M) 


Thus we can find the gain matrix K that will realize any desired characteristic equation. 

We wish now to make the following points. By some process we choose the root locations 
so as to satisfy design criteria such as speed of response, overshoot in the transient response, 
and the like (see Section 6.4). However, at this time no input has been shown; hence we cannot 
speak of overshoot to a step input. Once we have chosen à; and Ay, (9-9) will give the gain matrix 
needed to realize these characteristic-equation zeros. Then, to the extent that (9-1) is an accurate 
model of the physical servomotor, we will realize these zeros in the physical system. Obviously, 
we cannot increase the speed of response of a servo system without limit, even though (9-9) 
seems to indicate that we can. If we attempt to force the system to respond too rapidly, large 
signals will be generated and the plant will enter a nonlinear mode of operation; then (9-1) will 
no longer accurately model the plant. Hence, in choosing A, and \,, we must consider only those 
root locations that can be attained by the physical system. 

We will now develop a general procedure of pole assignment. Our nth-order plant is mod- 
eled by 


x(k + 1) = Ax(k) + Bu(k) (9-10) 


We generate the control input u(k) by the relationship 


u(k) = —Kx(k) (9-11) 
where 
K = [K Ky K] (9-12) 
Then (9-10) can be written as 
x(k + 1) = (A — BK)x(k) (9-13) 


and, in (9-4), Ay = (A — BK). We choose the desired pole locations 


As Mb Nos er Sy Nn (9-14) 
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Then the closed-loop system characteristic polynomial is 
a(z) = |Æ — A+ BK| = (z— Nz — Ay)? Ay) (9-15) 


In this equation there are n unknowns, Kj, Ky, ... , K,, and n known coefficients in the right- 
hand-side polynomial. We can solve for the unknown gains by equating coefficients in (9-15), 
as illustrated by the servomotor example above. An example will now be given to illustrate this 
procedure. 


EXAMPLE 9.1 


In this example the servomotor system of Fig. 9-1, with the state equations given in (9-1), will 
be considered. With full-state feedback, the characteristic equation is given in (9-6). Consider 
first that the closed-loop system is implemented with the usual unity feedback; then K; = 1 and 
K = 0. From (9-6), the characteristic equation is given by 


z? — 1.90000z + 0.90952 = 0 
This equation has roots at 


zı2 = 0.953692 (+ 0.087944 rad) = rZ( +0) 


From (6-8) we calculate the damping factor of these roots to be 


—Inr —In(0.95369) 
= = 0.47462 


= Vlnr)? + 62  Vn(0.95369))2? + (0.087944) 


and from (6-10), the time constant is 


-T -01 
Inr In(0.95369) 


= 2.109 s 


Suppose that we decide that this value of ¢ is satisfactory, but that a time constant of 1.0 s is 
required. Then 


T 
Inr = ->= -0.1 
T 


or r = 0.904837. Solving (6-8) for 0, we have 


0? = (s 1) = (m(0.904837)?( z 5 1) 
i (0.47462) 


or 9 is equal to 0.185453 rad, or 10.63°. Then the desired root locations are 


zı2 = 0.9048372(+0.185453) = 0.889322 + j0.166845 


Hence the desired characteristic equation is given by 
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a(z) = 2 — 2rcosð z + r? 
a 2(0.904837)cos(0.185453) z + (0.904837) 
= z? — 1.778644 z + 0.818731 


From (9-9), 
Kı = 105.0833[\jAz — (Ay + 2) + 1.0] 
105 .0833[0.818731 — (1.77864) + 1.0] = 4.212 
14.67494 — 5.34172 Ay — 5.16661(A; + Ad) 
= 14.67494 — 5.34172(0.818731) — 5.16661(1.77864) = 1.112 


Ky 


The initial-condition response of this system is given in Fig. 9-2, with x,(0) = 1.0 and 
x,(0) = 0. Both y(t), the output (Fig. 9-2(a)), and u(t), the sampler input (Fig. 9-2(b)), are shown. 


t (s) 


(a) 


t (s) 


(b) 
FIGURE 9-2 Initial-condition responses for the systems of Example 9.1. 
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Suppose that we decide that the foregoing value of € = 0.475 is satisfactory, but that a time 
constant of T = 0.5 s is required. This design is given as Problem 9.2-1. The gains obtained from this 
design are K = 15.15 and Ķ = 3.21, and the initial-condition response is also given in Fig. 9-2. 
Compare the control inputs u(t) for the two designs in Fig. 9-2. The maximum amplitude of u(t) for 
T = 1.0sis 4.21, while that for tT = 0.5 sis 15.15. Thus we see that an attempt to increase the speed 
of response of the system results in larger signals at the plant input. These larger signals may force the 
system into a nonlinear region of operation, which in some cases may be undesirable. 

A MATLAB program to perform the computations needed for this example is given below. 
Note that the format long is needed to display the parameters in sufficient precision. 


% First verify the closed loop roots with K1l=1, K2=0 
format long 


disp(' ') 

disp('Using MATLAB damp function’) 

Gp = tf([1], [1 1 0]); T = 0.1; Gz = c2d(Gp,T); 

Cz = feedback(Gz,1); Cz_zpk = zpk(Cz); [Wn,zeta,P]= damp (Cz) 
disp(' ') 


disp('Given system roots and gains K1 & K2:') 
% Using the format of Equation (1-18) 

Ac =[0 1;0 -1]; Be =[0;1]; Cc =[1 0]; Dc=0; 

Sysc = ss(Ac,Bc,Cc,Dc); T = 0.1; Sysd = c2d(Sysc,T); 
[A,B,C,D] =ssdata(Sysd) ; 

al2=A(1,2); a22=A(2,2); b11=B(1,1); b21=B(2,1); Kl=1; K2=0; 
% Find alphac using Equation (9-6) 

Cl=b11, C2=b21, C3=-1-a22 % For Equation (9-6) 
C4=-a22*bl1l+al2*b21, C5=-b21, C6=a22 % For Equation (9-6) 

alphac =[1 C1*K1+C2*K2+C3 C4*K1+C5*K2+C6] 

% alphac =[1 b11*K1+b21*K2-1-a22 (-a22*b11+a12*b21) *K1-b21*K2+a22] 
root = roots(alphac); real =(root(1)+root(2))/2; 

imag = abs(root(1)-root(2))/2; r = sqrt (real*2+imag*2) 

r_squared = r*2, theta = atan(imag/real) 

two_r_cos theta = 2*r*cos(theta), theta_deg = theta*180/pi 

zeta = -log(r)/sqrt(log(r)*2+theta*2), tau = -T/log(r) 
alphac_check = [1 -2*r*cos (theta) r^2] 

Gains check using Equation (9-9): Kl=1, K2=0 

Constants for Equation (9-9) 

Cl=1/ (b11-a22*b11+a12*b21), K1 = C1* (r*2-2*r*cos (theta) +1) 
X=b11/b21/ (b11-a22*b11+al2*b21) ; 

C2=(1+a22) /b21-X, C3=-X, C4=-1/b21+xX 
K2=C2+C3*r*2+C4*2*r*cos (theta) 

% Desired zeta is 0.47462 with new tau of 1.0 s 

disp(' ') 

tau = input('Desired tau = '); % enter 1.0 


2 
© 
2 

6 


disp('Desired new roots and gains K1 & K2:') 

r = exp(-T/tau), theta = sqrt (log(r)*2*(1/zeta*2-1) ) 
theta_deg=theta*180/pi 

alphac = [1 -2*r*cos(theta) r*2], roots _alphac=roots(alphac) 
zeta_check=-log(r) /sqrt (log(r)*2+theta*2), tau_check=-T/log(r) 
% Find new K1 and K2 using Equation (9-9) 
K1 = Cl* (r*2-2*r*cos (theta) +1) 
K2=C2+C3*r*2+C4*2*r*cos (theta) 


The system of Example 9.1 can be realized with the hardware configuration of Fig. 9-3. 
In Fig. 9-3(a) it is assumed that the gains of the sensors are unity; in the practical case these 


9.2 Pole Assignment 
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(b) 
FIGURE 9-3 Hardware implementation for the design of Example 9.1. 


a! 


gains would probably not be unity. For example, suppose that the sensors for position and 
velocity can be modeled as the constant gains H, and H,, respectively, over the closed-loop 
system bandwidth. The hardware configuration of the system would then be as shown in 
Fig. 9-3(b), where 


H,Kıa = 4.212,  H,Ka = 1.112 


In the procedure above the gain matrix K was calculated by equating coefficients in the 
characteristic equation of (9-15). This calculation is simplified greatly if the state model of the 
plant is in the control canonical form (see Section 2.9), which is the form 


OG. 0 > 0 0 
ees |" Ei olaaa | T l (9-16) 


0 AT Tay. A Taa 1 
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This plant has the characteristic equation, from Section 2.10, 
a(z) = |Æ- A| = 7 +a! + +--+ tazta=0 (9-17) 


For this state model, in (9-15) BK is equal to 


0 0 O ::: 0 
BK = ‘ A E a © S $ (9-18) 
l a E < 
Hence the closed-loop system matrix is 
A — BK = o 9 l F i (9-19) 
— (ay + K) (a +K) o -ani + Ky) 
and the characteristic equation becomes 
|z — A + BK| = z” + (a„-1 + Kz"! + +++ + (a) + Ky)z + (ap + Ki) = 0 (9-20) 
If we write the desired characteristic equation as 
a(z) = Z + ap! + o +az+a= O0 (9-21) 


we calculate the gains by equating coefficients in (9-20) and (9-21) to yield 
Kj41 = Qi — a; i= 0,1,...,n-1 (9-22) 
In general, the techniques for developing state models for plants do not result in the control 
canonical form (see Section 4.10). A more practical procedure for calculating the gain matrix K 
is the use of Ackermann’s formula [1]. The proof of Ackermann’s formula will not be given here 
(see [1] or [2]), but this proof is based on transformations from a general system matrix A to that 


of the control canonical form. 
We begin with the plant model 


x(k + 1) = Ax(k) + Bu(k) (9-23) 


The matrix polynomial a,(A) is formed using the coefficients of the desired characteristic 
equation (9-21). 


a(A) = A +a, A! + +++ + a,A + aol (9-24) 
Then Ackermann’s formula for the gain matrix K is given by 


K = [00 --- 01][B AB--- A’ 7B A'B] 'a,(A) (9-25) 


9.2 Pole Assignment 


The problems with the existence of the inverse matrix in (9-25) are discussed in Section 9.6. 
Example 9.1 will now be solved using Ackermann’s formula. 


EXAMPLE 9.2 


We will solve the design in Example 9.1 via Ackermann’s formula (9-25). The plant model is 
given by 


x(k + 1) = Ax(k) + Bu(k) = | ee sy ) pe 


lw 
0 0.904837 0.095163 


and the desired characteristic equation is 


a(z) = 2 — 1.778644z + 0.818731 


Hence 
1 0.095163 ]? 1 0.095163 1 0 
A) = — 1.77867 + 0.818731 
ae) f a af [ -o R i 
or 
0.040087 0.012009 
a(A) = 
0 0.028078 
Also, 
ie k a | x | 
0 0.904837 || 0.095163 0.08611 
Thus 


[B ABT! = pee o 


E 082 15.342 | 
0.095163 0.0861070 


105.082 —5.342 


Then the gain matrix is, from (9-25), 


—95.082 alee | 


K = [0 nf 
105.082 —5.342 || 0 0.028078 


= [4.212 1.112] 


These results are the same as those obtained in Example 9.1. 
A MATLAB program to compute the gain matrix is given by 


% Use the MATLAB acker function to find gains K 

A = [1 0.095163;0 0.904837]; B =[0.0048374; 0.095163]; T=0.1; 

% Set tau and zeta for desired roots of characteristic equation 
tau = 1.0; zeta = 0.47462; 

r = exp(-T/tau), theta = sqrt (log(r)^2*(1/zeta^2-1)) 

alphac =[1 -2*r*cos (theta) r*2], roots_alphac=roots (alphac) 
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% P specifies the desired roots 
P = roots (alphac) 
K = acker(A,B,P) % Ackermann computation 


9.3 STATE ESTIMATION 


In Section 9.2 a design technique was developed which requires that all the plant states be mea- 
sured. In general, the measurement of all the plant states is impractical, if not impossible, in all 
but the simplest of systems. In this section we develop a technique for estimating the states of a 
plant from the information that is available concerning the plant. The system that estimates the 
states of another system is generally called an observer [3], or a state estimator. Thus in this sec- 
tion we introduce the design of observers. 

Suppose that the plant is described by the following equation: 


x(k + 1) = Ax(k) + Buck) 
y(k) = Cx(k) (9-26) 


where y(k) are the plant signals that will be measured. Hence, in (9-26), we know the matrices 
A, B, and C, and the signals y(k) and u(k). The control inputs u(k) are known since we generate 
them. The problem of observer design can be depicted as shown in Fig. 9-4, where the observer 
is a set of difference equations to be solved by a digital computer. 

The states of the system to be observed are x(k); the states of the observer are q(k) and 
we desire that q(k) be approximately equal to x(k). Since the observer will be implemented on a 
computer, the signals q(k) are then available for feedback calculations. 


Observer Model 


Equations describing observers can be developed in several different ways; we choose here to 
take a transfer-function approach. The observer design criterion to be used is that the transfer- 
function matrix from the input u(k) to the observer state g,(k) be equal to that from the input u(k) 
to the system state x(k), fori = 1,2, ... ,. Equations describing the observer of Fig. 9-4 will 
now be developed, based on this reasonable criterion. 

First we take the z-transform of (9-26) and solve for X(z): 


zX(z) = AX(z) + BU(z) (9-27) 
or 
X(z) = (al — A) 'BU(z) (9-28) 


Now, since the observer has two inputs, y(k) and u(k), we write the observer state equa- 
tions as 


q(k + 1) = Fq(k) + Gy(k) + Huk) (9-29) 
Plant yb) Observer 

u(k) States -———— States| 4) 
x(k) — > qa% 


FIGURE 9-4 System illustrating state estimation. 


9.3 State Estimation 


where the matrices F, G, and H are unknown. Taking the z-transform of (9-29) and solving for 
Q(z) yields 


Qi) = A- PIGGY) + HUC) (9-30) 
From (9-26), 
Y(z) = CX(z) (9-31) 
Next we substitute (9-31) and (9-28) in (9-30): 


Q(z) 


(cl — F)'[GCX(z) + HU(2)] 
= (zI — F '[GC(al — A) 'B + HJU(z) (9-32) 


Recall that the design criterion is that the transfer-function matrix from U(z) to Q(z) be the 
same as that from U(z) to X(z). Thus, from (9-28), 


Q(z) = I- A) 'BU(z) (9-33) 
must be satisfied. Then, from (9-32) and (9-33), 
CI- A)'B = (al — F)! GCI- A) 'B + (I — F)'H (9-34) 


or 


[I — eI- F GCI — AB = I- F)'H (9-35) 
This equation can be expressed as 
I- Pk — F + GOKI- AB = l- FH 
Equating the postmultiplying matrices of (<I — F)! yields 
cI- A) 'B = [cI — Œ + GOH (9-36) 
This equation is satisfied if we choose H equal to B, and 
A =F+ GC (9-37) 
Therefore, from (9-29) and (9-37), we write the observer state equations as 
q(k + 1) = (A — GC)q(k) + Gy(k) + Buk) (9-38) 
and the design criterion (9-33) is satisfied. Note that G is unspecified. Hence the observer is a 
dynamic system described by (9-38), with y(k) and u(k) as inputs and with the characteristic 
equation 
|I- A+ GC| =0 (9-39) 


We call the observer of (9-38) a prediction observer, since the estimate at time (k + 1)T is based 
on the measurements at time kT. 
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Errors in Estimation 
We now consider the errors in the state-estimation process. Define the error vector e(k) as 
e(k) = x(k) — q(k) (9-40) 
Then, from (9-40), (9-26), and (9-38), 


ek+ 1) =xk+ 1)-— qk + 1) 
= Ax(k) + Bu(k) — (A — GO)q(k) — GCx(k) — Buk) (9-41) 
or 
ek + 1) = (A — GCO)[x(kK) — qi] = (A — GO)e(k) (9-42) 


Hence the error dynamics have a characteristic equation given by 
|zI — (A — GC)| = 0 (9-43) 


which is the same as that of the observer [see (9-38)]. 

We look next at the sources of the errors in state estimation. First, we have assumed that 
we have an exact model of the physical system involved. For example, in (9-41) we assumed 
that the A matrix in the plant’s state equations is identical to that in the observer’s equations. In a 
practical case we will have system models that only approximate the physical system. However, 
more effort expended in obtaining an accurate plant model will lead to improved state estimation. 

A second source of errors in our state estimation is in the choice of initial conditions for 
the observer. Since the initial states of the plant will not be known, the initial error e(0) will not 
be zero. However, provided that the observer is stable, this error will tend to zero with increasing 
time (assuming exact models), with the dynamics given by (9-43). 

The third source of errors is the plant disturbances and the sensor errors. The complete 
state equations of the plant, (9-26), become 


x(k + 1) = Ax(k) + Bu(k) + B,w(k) 
y(k) = Cx(k) + wk) (9-44) 


when the plant disturbance vector w(k) and the measurement inaccuracies v(k) are considered. 
Hence, if (9-44) is used in deriving the error state equations (9-42), we obtain 


e(k + 1) = (A — GC)e(k) + Bywtk) — Gv(k) (9-45) 
For this case, the errors in the state estimation will tend to zero if the estimator is stable (we will 
certainly require this); however, the excitation terms in (9-45) will prevent the errors from reach- 
ing a value of zero. 
Error Dynamics 
Consider now the observer state equations: 


[eq. (9-38)] q(k + 1) = (A — GO)q(k) + Gy(k) + But’) 


All matrices except G in this equation are determined by the plant equations (9-26); how- 
ever, the observer design criterion (9-33) is satisfied independent of the choice of G. Note that G 
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determines the error dynamics in (9-43). We generally use this fact in choosing G. A character- 
istic polynomial a,(z) is chosen for the error dynamics. Note from (9-38) and (9-43) that this is 
also the characteristic polynomial of the observer. Then 


az) = |z — (A — GO| = z?” + ayy z! + +++ + az + ao (9-46) 


For the case of a single-output system [i.e., y(k) is a scalar], 


G=]. (9-47) 
G, 
and (9-46) yields n equations by equating coefficients. Hence the solution of these equations will 


yield the G matrix of (9-47). For this case, Ackermann’s equation may also be employed. First 
we compare (9-46) to (9-15). 


[eq. (9-15)] a(z) = |zI — (A — BK)| 
Ackermann’s equation for the solution of this equation is given in (9-25). 
[eq. (9-25)] K = [00--- 0 1][B AB--- A’7B A’ |B] 'a(A) 
Thus Ackermann’s equation for G in (9-46) is seen to be 
c J fo 
G = a,(A) Fs : (9-48) 
ca] Li 


(The derivation of this result is given as Problem 9.3-4.) 

Thus we see that we can design the observer, once we decide on an appropriate charac- 
teristic equation in (9-46). An approach usually suggested for choosing a,(z) is to make the 
observer two to four times faster than the closed-loop control system. The fastest time constant 
of the closed-loop system, determined from the system characteristic equation, 


|zI — (A — BK)| = 0 (9-49) 


is calculated first. The time constants of the observer are then set at a value equal to from one- 
fourth to one-half this fastest time constant. 

The choice of G can be approached from a different viewpoint. The observer state equa- 
tion, from (9-38), can be written as 


q(k + 1) = Aqtk) + Gly(k) — Cq(k)] + Bulk) 


Thus the plant—observer system can be modeled as in Fig. 9-5. 

The choice of G can be viewed in the following manner. In Fig. 9-5, if x(k) and q(k) are 
approximately equal, there is little effect from the feedback through G. Hence q(k) is determined 
principally from u(k). However, if the effects of disturbances on the plant cause q(k) to differ 
significantly from x(k), the effect of G is much more important. Here the measurement of y(k) 
is more important in determining q(x) than in the first case. Thus we can view the choice of G 
as relating to the relative importance that we attach to the effects of u(k) and to the effects of 


355 


356  Chapter9 * Pole-Assignment Design and State Estimation 


Plant l 
] ] 
] ] 
u(k) l x(k) | y(k) 

A,B m C l 
| l 
| | 
| I 
] l 

Observer 

+ 
q(k) z 
A,B m C 
G (=a 


Lipo y Ss = iesit — sa S i 


FIGURE 9-5 Different view of state estimation. 


the disturbances on x(k). And, of course, we will have the effects of measurement noise (inac- 
curacies) on y(k). If these effects are great, the observer design cannot allow y(k) to have a large 
weight in determining q(k). 

We will now summarize the paragraph above. We can view G as furnishing a correc- 
tion input to the plant model in the observer in Fig. 9-5, to account for unknowns in the plant. 
If the unknowns are significant, G should be relatively large. However, if measurement noise 
in y(k) is significant, we cannot rely heavily on the measurement y(k), and G should be rela- 
tively small. Hence, for practical systems, perhaps the best method for choosing G is through 
the use of an accurate simulation of the system of Fig. 9-5 that includes both the disturbances 
and the measurement noise. Simulations should be run for different choices of G [obtained 
from different choices of a,(z)], with the final choice of G resulting from the best system 
response. 

An example of the design of a prediction observer will now be given. 


EXAMPLE 9.3 


We will design an observer for the system of Example 9.2, for which the plant state equations are 


1 0.095163 00048374 
x(k) + 
0 0.904837 0.095163 


yk) = [1 0] x(k) 


With the gain matrix 


x(k + 1) = | l% 


K = [4.212 1.112] 


9.3 State Estimation 


the closed-loop system characteristic equation is given by 
a(z) = z? — 1.778644z + 0.818731 


The time constant of the roots of this equation, from Example 9.1, is 1.0 s. Thus we will 
choose the time constant of the observer to be 0.5 s. We also choose the observer to be critically 
damped, with the roots 


z = e77 = gOS = 0.818731 
The observer characteristic equation is then 


a(z) = (z — 0.818731) = z? — 1.637462z + 0.670320 = 0 


c Įifo 
a TOPA H 


[1 0.095163 |? 1 0.095163 1 0 
= — 1.637462 + 0.67032 
Se LO aa PR p ed ee oa A 


The matrix G is given by (9-48): 


_ [0.032858 a 
0 0.007414 


foal =li wosia] ~[-tosonss inseoss 
CA [1 0.095163 —10.508286 10.508286 


Then 
ese all 1 0 7) 
0 0.007414 || — 10.508286 10.508286 || 1 
N ae 
0.077913 


The system matrix of the estimator is given by 


0.732624 ped 


F = A — e 
ce E 0.904837 
From (9-38), the estimator’s state equations are 


0.0048374 
0.095163 


0.267376 
0.077913 


0.732624 0.095163 


lw 
—0.077913 0.904837 


qk + 1) = Jaw + | jw + | 


But 
ulk) = —Kq(k) = —4.212q,(k) — 1.112q2(k) 


Then the estimator’s state equations become 
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FIGURE 9-6 Initial conditions responses for Example 9.3. 


0.267375 
0.077913 


0.712246 0.089784 


k+)= 
at ) = | -0.478776 0.799022 


bo 


Jo +| 


Initial-condition responses for the observer-based control system are given in Fig. 9-6. Two 
responses are given: one with 


q(0) = x(0) = P 


and the other with 


o-i} 0f] 
=j 0 


Thus we can see an effect of not knowing the initial state of the system. It should be noted that 
with q(0) and x(0) equal, the response of the observer-based control system is identical to that of 
the full-state feedback system of Example 9.1. 

The effects of a certain disturbance, a unit-step function, will now be illustrated. The dis- 
turbance enters the system as given in (9-44), with, for example, 


at 


Fig. 9-7 shows the disturbance response of both the observer-based system and the full-state 
feedback system with the unit-step disturbance. 

Since the observer does not take disturbances into account, the response of the observer- 
based control system differs significantly from that of the full-state feedback system. AMATLAB 
program that calculates the observer gains is given below. 

% Compute the plant’s discrete state-space matrices 


Ac=[0 1;0 -1]; Be=[0;1]; Cc=[1 0]; Dc=0; 
Sysc=ss(Ac,Bc,Cc,Dc); T=0.1; Sysd=c2d(Sysc,T) ; 


9.3 State Estimation 


0.5 Observer based 


PA Full-state feedback 


> 
0 1 2 3 4 t(s) 
FIGURE 9-7 Disturbance responses for Example 9.3. 


[A,B,C,D] =ssdata (Sysd) ; 

% Set tau and zeta for desired alphac roots 

tau = 1.0; zeta = 0.47462; 

r = exp(-T/tau), theta = sqrt (log(r)^2*(1/zeta^2-1)) 

alphac = [1 -2*r*cos (theta) r^2], roots_alphac=roots (alphac) 
P = roots(alphac) % P specifies the acker desired roots 

= acker(A,B,P) % Ackermann computation 

% Set tau and zeta for desired alphae roots 

tau = 0.5, zeta = 1 

r = exp(-T/tau), theta = sqrt (log(r)*2*(1/zeta*2-1) ) 

alphae =[1 -2*r*cos (theta) r*2], 

roots alphae=roots (alphae) 

Perr = roots(alphae) % Perr specifies the acker desired roots 
G =(acker(A',C',Perr))' % Ackermann computation 


A 


2 


Controller Transfer Function 


We will now relate pole-assignment-estimator design to controller design by the procedures of 
Chapter 8. The observer equations are, from (9-38), 


[eq.(9-38)] q(k + 1) = (A — GC)q(k) + Gy(k) + Bulk) 
and the control law is given by 
ulk) = —Kaq(k) (9-50) 

Substitution of the equation for u(k) into the observer equations yields 

q(k + 1) = (A — GC — BK)q(k) + Gy(k) 
Taking the z-transform of this equation and solving for Q(z) yields 

Q(z) = (dl — A + BK + GC) 'GYXz) 

Substituting this equation into that for U(z) results in the relationship 


UZ) = -KKI — A + BK + GC) GYG) 
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FIGURE 9-8 Digital-controller realization of the system. 


Hence we can consider the controller-observer combination to be a digital controller with the 
transfer function 


DZ) = at = KI — A + BK + GO) 'G (9-51) 


and model the closed-loop system as shown in Fig. 9-8(a). 

Note that, for this controller, — Y(z) is the input, and U(z) is the output. In Fig. 9-8(a) we 
show the control system as an equivalent unity-gain feedback system, with the system input 
equal to zero. Fig. 9-8(b) gives the hardware configuration. We can also view the system with no 
input shown, as in Fig. 9-8(c). The system characteristic equation can be expressed as 


1 + Dee(z)G(z) = 0 (9-52) 


We will now determine the equivalent digital controller transfer function D.,(z) for the design 
of Example 9.3. 


9.3 State Estimation 
EXAMPLE 9.4 


The system equations for the system of Example 9.3 are 


1 0.095163 0.0048374 
x(k) + 
0 0.904837 0.095163 


yk) = [1 O}x(k) 


x(k + 1) = | Jw 


with control gains 
K = [4.212 1.112] 


In Example 9.3 the observer equations were calculated to be 
q(k + 1) = (A — BK — GO)q(k) + Gy(k) 


0.267376 


-| 0.712247 0.089784 
0.077913 


k 
—0.478776 0.799022 px 


Jaw + | 
u(k) = —Kq(k) = —[4.21240 1.11195]q(k) 


Now, in (9-51), 


z — 0.712247 all 


(dl - A+ BK +GC)! = | 
0.478785 z — 0.799021 


and 
A = |z — A + BK + GC| = 2 — 1.51127z + 0.612087 


The digital controller transfer function is, from (9-51), 


D,Az) = KCI — A + BK + GC)'G 


1 [z — 0.79902 0.089784 ][ 0.26738 
= [4.21246 1.11195]—|* || | 
A| —0.47874 z — 0.712245 || 0.077913 
= 11421246 — 3.89817 1.11195z — 041377] oaan | 
AS ates: ia 0.077913 


1.2129(z — 0.8859) 
2 — 1.511z + 0.6121 


It is seen that a second-order digital controller has been designed for this system by using a mod- 
ern control approach. MATLAB code for this example follows. 


% Append this code to the program for Example 9.3 
Aq = A-B*K-G*C, Bq = G, Cq = -K 

[NUMce, DENce] =ss2tf (Aq,Bq,Cq,0) ; 

Dee=tf (-NUMce, DENce,0.1); 

Dce=zpk (Dce) 
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% Alternative method using (9-51) 

% Store this NICE function 

function [nr2,dr2]= nice(old,z) 

% NICE takes the original expression and makes it look nice 
% Input: (a*z*2 + b*z + c)/(d*z*2 + e*z + f) 

% Output: (al*z*2 + bl*z + cl)/(z*2 + e1*z + f1) 

% old contains symbol of z 

% rearrange the expression to collect coefficients 

new = collect (old,z); 


2 


% obtain the coefficients of numerator and denominator 

dr = fliplr(coeffs(feval (symengine, 'denom',new) )) ; 

nr = fliplr(coeffs(feval (symengine, 'numer',new) )) ; 

% normalize the coefficients with the coeff of dr z*2 term 
dr2 = double(dr/dr(1)); nr2 = double(nr/dr(1)); 

end 


syms z, Dce=K*inv((z*eye (2) -A+B*K+G*C) ) *G; 
[num, den] =nice(Dce, z); 
Dce=tf (num,den,T); Dce=zpk (Dce) 


Closed-Loop Characteristic Equation 


As a final point, we must investigate the effects on the closed-loop system characteristic 
equation of the addition of the observer. For full-state feedback, the characteristic equation is 
given by 


a(z) = |z — A + BK| =0 


We will now derive the system characteristic equation for the observer-based control 
system. 
To derive this equation, we will use the error variables of (9-40). 


[eq. (9-40)] e(k) = x(k) — q(k) 
The plant state equations of (9-26) can be expressed as 
x(k + 1) = Ax(k) — BKq(k) = (A — BK)x(k) + BKe(k) (9-53) 
The state equations for the error variables are 


[eq. (9-42)] e(k + 1) = (A — GC)e(’) 


We can adjoin the variables of (9-53) and (9-42) into a single state vector, with the resulting 
equations 


ies + n a k — BK BK le] (9-54) 


ek +1)} 0 A — GC |l ek) 


with the states of the observer a linear combination of x(k) and e(k), given in (9-40). 


[eq. (9-40)] e(k) = x(k) — q(k) 
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Thus the characteristic equation of the state equations of (9-54) is also the closed-loop system 
characteristic equation. This equation is seen to be 


|z — A + BK||zdl — A + GC| = a,(2)a,(z) = 0 (9-55) 
We see then that the roots of the characteristic equation of the closed-loop system are the roots 


obtained by the pole-placement design plus those of the observer. Hence the pole-placement 
design is independent of the observer design. 


EXAMPLE 9.5 


We will now calculate the characteristic equation for the system of Example 9.4. Now 


1 | _ 0.004837z + 0.004679 


go 1 
Go z 
© z E +D] z2 — 1.905z + 0.9048 


Hence, from Example 9.4 and Fig. 9-8, the closed-loop system characteristic equation can 
be expressed as 


1.2129(z — 0.8859) \ F oe) 


1 + Del2Z)G(z) = 1 + 
(z)G(z) (z — 1.511z + 0.6121 z — 1.905z + 0.9048 


This equation can be evaluated as 
zf — 3.416z° + 4.4012 — 2.533z + 0.5488 = 0 
The product «,(z)a,(z) is, from Examples 9.1 and 9.3, 
a(z)a(Z) = (z? — 1.7786z + 0.8187)(z2 — 1.6375z + 0.6703) 


and expansion of this equation yields the fourth-order polynomial above. 


Closed-Loop State Equations 


The transfer-function model of the closed-loop system is given in Fig. 9-8. A state model of the 
closed-loop system will now be derived. From (9-26) and (9-50), 


x(k + 1) = Ax(k) — BKq(k) 
and from (9-26), (9-38), and (9-50), 
q(k + 1) = GCx(k) + (A — GC — BK)q(k) 


We adjoin the foregoing two equations to form the closed-loop state model. 


ea | 7 | A — BK ise sui 
qk+1] LGC A- GC- BK] qh’) 050) 
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This model is useful in writing simulations of the closed-loop system. If the disturbance inputs and the 
sensor-noise inputs are added as in (9-44), the closed-loop model is more complex (see Problem 9.3-5). 


EXAMPLE 9.6 


The closed-loop state matrix of (9-56) will now be calculated for the system of Example 9.5. 
Now, from Example 9.3, 


.0048374 .020377 : 7 
BK = p p18? Jz 1.11195] = h P203 Vee a] 
0.095163 0.40087 0.10582 
0.26738 0.26738 (0) 
ees [ioli =] | 
0.077913 0.077913 0 
From Example 9.4, 


0.71225 a 


A — GC - BK = 
oe E 0.79902 


The closed-loop system matrix, from (9-56), is then 


1 0.09516 —0.02038 —0.00538 
A -BK la 0 0.90484 —0.40087 —0.10582 
GC A-GC-BK]_ | 0.26738 0 0.71225 0.08978 
0.07791 0 —0.47878 0.79902 


A MATLAB statement to generate this closed-loop matrix is [A -B*K;G*C A-G*C-B*¥K]. 
Of course, the characteristic equation of this matrix is the same as that of (9-52) and (9-55). The 
interested reader may verify that the closed-loop system matrix calculated in this example has 
the same characteristic equation as (9-52), which was calculated in Example 9.5. 


This section has presented a brief introduction to observers. References [2], [4], [5], and 
[6] expand on the developments of this section. 


9.4 REDUCED-ORDER OBSERVERS 


In the example in Section 9.3, we estimated x(k) [position] and x(k) [velocity], given the measure- 
ment of position. However, if an accurate measurement of position is available, it is not necessary 
to estimate position; we already know it. In general, if accurate measurements of certain states are 
made, one needs to estimate only the remaining states, and the accurately measured signals are then 
used directly for feedback. The resulting observer is called a reduced-order observer. However, if 
the measurements are relatively inaccurate (noisy), the full-order observer may yield better results. 

To develop the design equations for the reduced-order observer, we first partition the state 
vector as 


md 
x(k) 
where x,,(k) are the states to be measured and x;(k) are the states to be estimated. 


x(k) = | 
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Then the plant state equation of (9-26) can be partitioned as 


i T p| = be ele) 4 KHG 


x(k + 1) Apa App JLxp(k) B, 
Xq(k) 
yk) = Ul oy (9-57) 
Note that in this case we are considering both multiple inputs and multiple outputs. 
The equations for the measured states can be written as 

Xalk + 1) = Aaa Xalk) + AgpXp(k) + Bauk) 
Collecting all the known terms on the left side of the equation, we write 

Xalk + 1) — AgaXalk) — Bau(k) = AgpXp(k) (9-58) 


For the reduced-order observer we consider the left side to be the “known measurements.” From 
(9-57), the equations for the estimated states are 


x(k + 1) = ApgXalk) + AppXp(k) + Bulk) (9-59) 


The term [A,,, x,(k) + B, u(4)] is then considered to be the “known inputs.” We now compare 
the state equations for the full-order observer to those for the reduced-order observer. 


[eq. (9-26)] x(k + 1) = Ax(k) + Bu(k) 

[eq. (9-59)] x(k + 1) = Ap Xak) + [Apa Xa(k) + Bpu(k)] 
and 

[eq. (9-26)] y(k) = Cx(k) 

[eq (9-58)] Xalk + 1) = AgaXa(k) — Bau(k) = Agoxp(k) 


We then obtain the reduced-order observer equations by making the following substitutions into 
the full-order observer equations (9-38): 


x(k) <— x(k) 
A <— Ap, 
Buk) — ApgXa(k) + B,u(k) 
yk) © Xalk + 1) = AgaXa(k) — Bauk) 
C<— Am 


If we make these substitutions into (9-38), 


[eq. (9-38)] q(k + 1) = (A — GC)q(k) + Gy(k) + Buk) 
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we obtain the equations 
qk + 1) = (Ap — GAgy)qn(k) + GIxg(K + 1) — AgaXa(k) — Bu(k)] 

+ ApgXa(k) + Bpu(k) (9-60) 

From (9-57), 
y(k) = x(k) (9-61) 
Then (9-60) can be written as 
qy(k + 1) = (Ay, — GAg,)ay(k) + Gy(k + 1) + (Apa — GA,,)y(k) 
+ (B, — GB,)u(’) (9-62) 


The following points should be made about the reduced-order observer. The observer character- 
istic equation is 


a(z) = |zI — Ay, + GA,,| = 0 (9-63) 


and G is determined from (9-63) in the same manner that the G matrix is obtained from (9-46) 
for the full-order observer. For the case of a single measurement [i.e., y(k) is x;(k)] Ackermann’ s 
formula is given by 


A, | [0 
A pA 0 

G=a,(A;)| 9 : (9-64) 
he Ni? Li 


Note also that, in (9-62), the measurements y(k + 1) is required to estimate q,(k + 1). However, 
for the full-order observer, in (9-38), q(k + 1) is estimated using only the measurements y(k). 
As in the case of the full-order prediction observer, we can derive the transfer function 
D-.-(Z), in Fig. 9-8, of the equivalent digital controller. Since the derivation of the transfer func- 
tion follows the same procedure as in the full-order observer case, this derivation is given as 
Problem 9.4-4. It is assumed that y(k) = x;(k), and that the gain matrix K is partitioned as 


u(k) = -KK gO = -iK KDK go 


—Kyyk) — K,q,(4) (9-65) 


where [-]" indicates the transpose of the matrix [-]. The derivation results in the transfer function 


—U(z) 
Y(z) 


Doek) = 


= K, + K,[zI — A,, + GA,, + (B, — GB,)K,]' 
i [Gz + {Apa GA, K\(B, GB,)}] (9-66) 


An example of the reduced-order estimator will now be given. 


9.4 Reduced-Order Observers 


EXAMPLE 9.7 


We will again consider the design of the system of Example 9.1. The plant model is given by 


1 0.095163 0.0048374 
x(k) + 
0 0.904837 0.095163 


yk) = [1 O}x(k) 


x(k + 1) = | lw 


with the gain matrix 
K = [4.212 1.112] 


and the closed-loop system characteristic equation 
a(z) = z — 1.778644z + 0.818731 


We are measuring position, xı(k), and will estimate velocity, x2(k). In Example 9.3 we chose the 
estimator characteristic-equation roots to be at z = 0.819; we will make the same choice here. 
However, the reduced-order observer is first order; hence 


a,(z) = z — 0.818731 = 0 
From the plant state equations above, and (9-57), the partitioned matrices are seen to be 


Aa = 1 Ag = 0.095163 B, = 0.0048374 
Apa = 0 Ap = 0.904837 B, = 0.095163 


Thus we have all the terms required for Ackermann’s formula in (9-64). 
G = a,(Aj,)[Ags] [1] = [0.904837 — 0.818731][0.095163]~'[1] 
= 0.9048 
The observer equation is given by (9-62): 


gk + 1) = [0.904837 — (0.9048)(0.095163)]q(k) + 0.9048 wk + 1) 
+ [0 — (0.9048)(1)]y(k) + [0.095163 — (0.9048)(0.0048374)]u(k) 


or 
gk + 1) = 0.8187q(k) + 0.9048y(k + 1) — 0.9048y(k) + 0.0908u(k) 


Here q(k) is the estimate of velocity, x2(k). Since we have considered the measurement y(k) to be 
the measurement at the present time, the implementation of the observer is more obvious if we 
replace k with (k — 1) in the observer equation: 


qk) = 0.8187q(k — 1) + 0.9048y(k) — 0.9048y(k — 1) + 0.0908u(k — 1) 


and q(k) is the estimate at the present time. From Example 9.1 the control law is given by 


ulk) = —4.212x,(k) — 1.112x5(k) 
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which is implemented as 
u(k) = —4.212y(k) — 1.112q(k) 
Hence we can write the observer equation as 
qk + 1) = 0.8187q(k) + 0.9048y(k + 1) — 0.9048y(k) + 0.0908[—4.212 y(k) — 1.112q(k)] 
or 
qk + 1) = 0.7177q(k) + 0.9048y(k + 1) — 1.2872y(k) 


The control system is then implemented as follows. A measurement y(k) is made at t = kT. The 
observer state is calculated from 


glk) = 0.7177q(k — 1) + 0.9048y(k) — 1.2872y(k — 1) 
Then the control input is calculated, using 
u(k) = —4.212y(k) — 1.112q(k) 


The initial-condition response, obtained by simulation, is approximately the same as that 
obtained using full-state feedback. In addition, the effects of the disturbance input are less than 
those for the full-order observer system. 

The observer gain for this example is calculated by the MATLAB program 


A =[1 0.095163; 0 0.904837]; B=[0.0048374; 0.095163]; 
alphae =[1 -0.818731]; 

Aaa = A(1,1); Aab = A(1,2); Aba = A(2,1); Abb = A(2,2); 
Ba=B(1,1); Bb=B(2,1); 


Perr = -alphae(2) 
G =(acker(Abb',Aab',Perr))' % Substitute Abb-->A and Aab-->C 
EXAMPLE 9.8 


We will now calculate the transfer function of the controller-estimator for the system of 
Example 9.7. From Example 9.7, G = 0.9048 and 


Aga = 1 Aap = 0.095163 B, = 0.0048374 K, = 4.212 
Aba = 0 App = 0.904837 B, = 0.095163 K, = 1.112 
and from (9-66), 


—U(z) 
Y(z) 


= K, + Kiz + CJ '[Gz + C2] 


Doek) = 


Cı = —Apy + GAg + (By — GB,)K), 
Cy = Aba GAga K(B, GB,) 


K,(Gz + C 
=e oe (GZ 2) 
z + Ci 
_ Kiz + Ci) + K(Gz + O) 
g Cy 


9.5 Current Observers 


_ (K T K,G)z + (KC; T K,C)) 


Ze Cı 
K, + K,G 
= (K, + K,G) 
zt Cı 
_ C3(z + C4) C3 = K; + K,G, 
gt Ci Cy = (KiC, + KC)/C 


5.2181(z — 0.8537) 
z — 0.7178 


Since the zero is closer to z = 1 than is the pole, the control-estimator is phase lead. This must 
be true independent of the design procedure, since the system is designed to increase the speed of 
response, as specified in Example 9.1. MATLAB code for this example is given below. 


% Using (9-66) 

syms z 

Aaa=1; Aab=0.095163; Aba=0; Abb=0.904837; 

Ba=0.0048374; Bb=0.095163; 

K1=4.212; Kb=1.112; G=0.9048; 

Dce=K1+Kb* inv (z*eye (1) -Abb+G*Aab+ (Bb-G*Ba) *Kb) * (G*z+ (Aba-G*Aaa-K1* 
(Bb-G*Ba) )); 

[num, den] =nice(Dce,zZ) ; 

Dce=tf (num, den, -1); Dce=zpk (Dce) 


9.5 CURRENT OBSERVERS 


The estimator developed in Section 9.3 is a prediction observer, since the estimate of x(k) is 
based on the measurement y(k — 1). However, the reduced-order observer of Section 9.4 esti- 
mates states at time kT using the measurement at time kT. We call this type of estimator a current 
estimator, or current observer. We will now consider a full-order current estimator. 

As before, the system model is given by 


[eq. (9-26)] x(k + 1) = Ax(k) + Buk) 
y(k) = Cx(k) 
We wish to estimate the state vector x(k) with the vector q(k). One form of a full-order current 
observer is given by the two equations 
qk + 1) = Aq(k) + Buk) 
qk + 1) = q(k + 1) + G[y(k + 1) — Cq(k + 1)] (9-67) 
In these equations, q(k + 1) is a first estimate of the state at time (k + 1)T, based on the dynam- 


ics of the system and on the signals at time kT. This estimate is then corrected in the second equa- 
tion when the measurement at time (k + 1)T arrives. The estimator gain is G, which determines 
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the weight placed on the difference between measurement at (k + 1)T and what we expect that 
measurement to be at that time. The final estimate is q(k + 1). 

In (9-67), the first estimate q(k + 1) can be eliminated by substituting the first equation 
into the second one. The single equation for the estimate is then 


q(k + 1) = [A — GCA]q(k) + [B — GCB]u(k) + Gy(k + 1) (9-68) 


We see then that the estimate at time (k + 1)T is based on the measurement at (k + 1)T. The 
dynamics of this estimator are described by the characteristic equation 


|z — A+ GCA| = 0 (9-69) 
It can be shown that this estimator has the same property as the prediction estimator; the 
transfer matrix Q(z)/U(z) is equal to the transfer matrix X(z)/U(z). The proof of this property is 
straightforward, and is given as Problem 9.5-6. 
As in the prediction-observer case, we define the estimation-error vector e(k) by the 
relationship 
ek) = x(k) — q(k) (9-70) 
Then 


e(k + 1) 


x(k + 1) — q(k + 1) 
Ax(k) + Bu(k) — [A — GCA]q(k) 

—[B — GCB]u(k) — GC[Ax(k) + Bu(k)] 

= [A — GCA][x(k) — q(k)] = [A — GCA]e(k) 


(9-71) 


from (9-26) and (9-68). Hence the error vector has dynamics with the same characteristic equa- 
tion as the estimator, (9-69). 
The characteristic equation for the prediction observer is 


[eq. (9-43)] II-A +GC] =0 
and for the current observer is 
[eq. (9-69)] | <I -A+ GCA| =0 


Thus, for a single-input single-output system, Ackermann’s formula for the current observer is 
obtained from that for the prediction observer, (9-48), by replacing C with CA; hence, for the 
current observer, 


ca |o 


2; 
G = «,(A) is 9 (9-72) 


cæ] li 


9.5 Current Observers 


A pole-placement design implemented with a current observer can be viewed as a digital- 
controller design as shown in Fig. 9-8, with the controller-estimator transfer function given by 


D.Az) = zK[zl — A + GCA + BK — GCBK]"'G (9-73) 


(see Problem 9.5-6). The current-observer design will now be illustrated with an example. 
EXAMPLE 9.9 


We will again consider the system of the earlier examples: 


1 0.095163 0.0048374 
x(k) + 


k+1)= 
nae i 0.904837 0.095163 


lw 


yW = [1 O}x(k) 


with the gain matrix 
K = [4.212 1.112] 
and the closed-loop system characteristic equation is given by 
a(z) = z? — 1.778644z + 0.818731 


We will use the same observer characteristic equation as used for the prediction observer of 
Example 9.3. 


a(z) = (z — 0.818731)? = z? — 1.637462z + 0.670320 = 0 


From Example 9.3, 


0.032858 0.025444 
a(A) = 
0 0.007414 
Also, 
CA =[1 0.095163] 
and thus 
1 0.095163 
A = (CA)A = [1 0951 = [1 0.18127 
C (CA) [1 0.095 63] | | [1 0.18127] 
Then 
Pelt B i Sa _ | 2.105171 a 
Cx’ 1 0.18127 —11.61346 11.61346 
From (9-72), 


CA |o 
ail aA Go| H 
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ao | 2.105171 oll 


0 0.007414 || -11.61346 11.61346 || 1 
E agus eae £ koad 
0 0.0074138 || 11.613456 0.086106 


The difference equation of the observer in (9-68) will now be evaluated. 


| 0.259434 1 0.0951 
cca = [oean | | eal 


| 0.086102 0 0.904837 
| 0.259434 


= 1 0.0951 
eal peat 


__ [0.259434 | 
| 0.086102 0.008194 


and 


74 070474 
a-eca =| 0.740566 0.070 | 


—0.086102 0.896643 


Also, evaluation of (B — GCB) yields 


aoe 


B — GCB = 
a Rarer 


We see then from (9-68) that the observer is implemented as 


0.740566 0.070474 


0.003582 0.259181 
qk + 1) = u(k) + 
—0.086102 0.896643 


þa + 1) 
0.094746 0.086106 


Jo- 


The gain vector G is calculated by the MATLAB program 


A=[1 0.095163; 0 0.904837]; 
alphae=[1 -1.637462 0.670320] ;B=[0.0048374; 0.0951630];C=[1 0]; 


Perr = roots(alphae); % Perr specifies the desired roots 
CA = C*A; 
G =(acker(A',CA',Perr))' % Substitute C*A--sA 


EXAMPLE 9.10 


This example is a continuation of the last example. The transfer function of the controller estima- 
tor will be calculated from (9-73). From Example 9.9, 


Acca =| 2740566 0.070474). cop = | 


ee 
—0.086102 0.896643 


0.094746 


9.5 Current Observers 


Hence 


and 


0.0035836 


(B — GCB)K = | 
0.0947465 


01 , 4 
Juz 1112) = Be 5096 0.00398 l 


0.399110 0.1053532 


0.725723 a 


A — GCA — BK + GCBK = | 
—0.485210 0.791290 


z — 0.725723 —0.066514 |7! 
I — A + GCA+ BK — GCBK]! = 
[z l | 0.485210 z- | 
o1 K — 0.791290 pve 
A| —0.485210 z — 0.725723 |’ 


A = |zI — A + GCA+ BK — GCBK| 
= 2 — 1.517z + 0.6065 


Then, from (9-73), 


Delz) = zK[zl — A + GCA + BK — GCBK]'G 


z — 0.791290 a 
—0.485210 z — 0.725723 || 0.086100 


Z 
= —[4.212 1.112 
AL i 


0.259181 z — ul 
0.086100 z — 0.188242 


1.188z — 1.049 1.188z(z — 0.8834) 


z? — 1.517z + 0.6065 z? — 1.517z + 0.6065 


Z 
= —[4.212 1.112 
Al i 


Here is a MATLAB program to compute the transfer function using (9-73). The code generates 
a transfer function in z using the nice function employed in Example 9.4. 


SCompute the digital filter using Equation (9-73) 

T=0.1; syms z 

A=[1 0.095163;0 0.904837] ;B=[0.0048374;0.0951630];C=[1 0]; 
alphae=[1 -1.637462 0.670320]; Perr=roots (alphae); CA=C*A; 
K =[4.212 1.112]; G =(acker(A',CA',Perr))'; 

Dce=z*K* inv (z*eye (2) -A+G*C*A+B*K-G*C*B*K) *G % Eqn (9-73) 
{num,den]= nice(Dce,z) ; 

Dee tf (num, den, T) 

Dce zpk (Dce) 


A problem can occur in the implementation of observer-based controllers. Thus far we have 


not considered the relative stability of these control systems. A system that has adequate stability 
margins is said to be robust; observer-based control systems may not be robust in terms of the gain 
and phase margins that appear at the input to the plant. To determine these stability margins, we see 
from Fig. 9-8 that the frequency response for the open-loop function D,,(z)G(z) must be calculated. 
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This was done for the prediction-observer system of Example 9.4 and the current-observer system 
of Example 9.9. In both systems the phase margin is 49° and the gain margins are greater than 8 
dB. In these systems no relative-stability problems appear. This problem is discussed further, when 
Kalman filters (which are optimal current observers) are discussed in Chapter 11. 

As in the case of the prediction observer in (9-56), the state model of the closed-loop sys- 
tem employing the current observer can be derived as 


p + | Z | A -BK jo vor 
q(k + 1) GCA A- GCA - BK || q% 


The derivation of this equation is straightforward and is given as an exercise in Problem 9.5-7. 


9.6 CONTROLLABILITY AND OBSERVABILITY 


In the preceding sections Ackermann’s formula was useful in both pole-assignment design, 
(9-25), and observer design, (9-48). In pole-assignment design it was necessary that the inverse 
of the matrix 


[B AB 4B... A’ 'B] (9-75) 
exist, and in prediction-observer design it was necessary that the inverse of the matrix 


C 
Cæ (9-76) 


Ca! 


exist. We will now relate the existence of the inverses of (9-75) and (9-76) to the important con- 
cepts of controllability and observability, respectively. 

We introduce the concept of controllability with respect to the system of Fig. 9-9. 

The system characteristic equation is given by 


(z — 0.9)(z — 0.8) = 0 


IGS et A ea oO ET 


U(z) 


hy ac ee Se eel Senta at esa Se 


FIGURE 9-9 Uncontrollable system. 


9.6 Controllability and Observability 


However, the mode of the transient response (0.9)* is not excited by the input u(k) and 
hence cannot be controlled by u(k). This system is said to be uncontrollable. 


DEFINITION 1. A system 
x(k + 1) = Ax(k) + Bu(k) (9-77) 


is controllable provided that there exists a sequence of input u(0), u(1), u(2), ... , u(N) that 
will translate the system from any initial state x(0) to any final state x(N), with N finite. 

Note that in the system of Fig. 9-9, the input u(x) has no influence on the state of the upper 
block; thus the system is uncontrollable. 

We will now derive the conditions for the system of (9-77) to be controllable. Now 


x(1) = Ax(0) + Bu(0) 
x(2) = Ax(l) + Bu(1) 
= Ax(0) + ABu(0) + Bu(1) 


(9-78) 
x(N) = Ax(0) + AY'Bu(O) + -+ + ABu(N — 2) + Bu(W — 1) 
uN — 1) 
= AYx(0) + [B AB --- A'B] pi =A (9-79) 
u(0) 
Hence, with x(N) and x(0) known, this equation can be written as 
uN — 1) 
[B AB --- AY-'B aA ~ 7) he RO) (9-80) 
u(0) 


Since the order of the state vector x(k) is n, then (9-80) yields n linear simultaneous equations. 
Hence, for a solution to exist, the rank of the coefficient matrix [which is (9-75) for N equal to n] 


[B AB --- A'B] (9-81) 


must be n [7]. For the case of a single input, B is a column matrix and (9-81) is n X n for N equal 
to n. Then the inverse of (9-81) must exist; this is also the condition for the existence of the solu- 
tion to Ackermann’s formula, in (9-25). 

We consider next the concept of observability. 


DEFINITION 2. A system 
x(k + 1) = Ax(k) + Bu(k) 
y(k) = Cx(k) (9-82) 
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System 
a ee 
| | 
l 1 
è i 
I > i I 
i z—0.9 i 
j I 

U(z) | | Y(z) 

TN 
| | 
i + 
| I 
I z I 
| 08 | 
I I 
I I 
j j 
| | 


fh ae a ce a al a a ae a an a cel 


FIGURE 9-10 Unobservable system. 


is observable provided that the initial state x(0), for any x(0), can be calculated from the N mea- 
surements y(0), y(1),..., y(N — 1), with N finite. 

A system that is obviously unobservable is shown in Fig. 9-10, since the state of the upper 
block does not contribute to the output y(k). 

The derivation of the criteria for observability closely parallels that for controllability. To 
simplify the derivation, we will assume that u(k) is zero; the derivation for u(k) not equal to zero 
is similar, and is given as Problem 9.6-1. Now, from (9-82), 


y(0) = Cx(0) 
y(1) = Cx(1) = CAx(0) 


y(N — 1) = Cx(N — 1) = CAY!x(0) (9-83) 
or 
y(0) C 
y0) she lay (9-84) 
yN — 1) cA! 


Hence, by the same arguments as for controllability, the rank of the coefficient matrix (which is 
(9-76) for N equal to n) 


C 

A 
(9-85) 
Ca- 1 


must be n. For the case of a single output, C is a row matrix and (9-85) is n X n for N equal to 
n. Then the inverse of (9-85) must exist; this is the condition for the existence of the solution to 
Ackermann’s formula, (9-48). 


9.6 Controllability and Observability 


EXAMPLE 9.11 


We will test the system of Fig. 9-11 for both controllability and observability. This system is 
composed of two cascaded first-order subsystems, each of which is controllable and observable, 
which is seen by inspection. The system state equations are given by 


—0.2 0 
=! 0.8 


yk) = [71 1]x(k) + ulk) 


x(k + 1) = | ko + HO 


First we will test for controllability, using (9-81). 
—0.2 1 —0.2 
am [2 aslla = [oa] 
=] 0.8 JL 1 —0.2 
and thus 


1 =| 


Ben $ —0.2 


This matrix is of rank 1 and its inverse does not exist; hence the system is uncontrollable. 
Next we will test for observability, using (9-85). 


and thus 
EET 
CA —0.8 0.8 
This matrix is also of rank 1; hence the system is unobservable. It is instructive to calculate some 


transfer functions. By Mason’s gain formula and from Fig. 9-11, 


Yz) 1. — 062° — 0.167°) = z '( = 0.87 D+ 2 + 0.27) - z? 


Uz) 1 +0.27! — 0.87! — 0.1672 
=] 
uk) i t x(k t ¥(z) 
-a : O ma -9 oma 
0.2 jæ 0.8 


FIGURE 9-11 System for Example 9.11. 
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XD oe MAO gs PH Rs z! 
U(z) 1 — 0.67! — 1627 1+02z! 
X) z 


Uz)  1+0.2z7! 


Yz) Yz) U) _ 1 +0.27! 
Xi) UQ) X2) ga 


From the transfer function X,(z)/U(z), we see that the mode (0.8)* is not excited by the input. 
From the transfer function Y(z)/X,(z), we see that the mode (—0.2)* does not appear in the 
output. 

Here is a MATLAB program to perform the computations of this example. 

A=[-0.2 0;-1 0.8]; B=[1; 1]; C=[-1 1]; D=[1]; 

T=1; Choose any sampling interval 

Sysd=ss(A,B,C,D,T) 

S_control=[B A*B] 

Rank_S_control=rank(S_ control) 

S_observe=[C; C*A] 

rank_S_ observe=rank(S_observe) 

Yz_over_ Xz = tf (Sysd) 


9.7 SYSTEMS WITH INPUTS 


In the pole-assignment design procedures presented in this chapter, the design resulted in a sys- 
tem in which the initial conditions were driven to zero in some prescribed manner; however, 
the system had no input. This type of system is called a regulator control system. However, in 
many control systems, it is necessary that the system output y(t) follow, or track, a system input 
r(t). An example of this type of system is the vertical (or altitude) control system of an aircraft 
automatic landing system. The aircraft follows a prescribed glide slope, which is a ramp func- 
tion. Hence the altitude control system input is a ramp function. In this section some techniques 
will be presented for modifying the pole-assignment design method for systems that must track 
an input. 

We first consider the case of low-order single-input single-output systems in which all 
states are measured; thus no observer is required. The system equations are given by 


x(k + 1) = Ax(k) + Bu(k) 
y(k) = Cx(k) (9-86) 


where, for a regulator control system, 
ulk) = —Kx(k) (9-87) 


The control input u(x) is the only variable that we can manipulate; thus this input must then be a 
function of the system input 7(k). Thus we modify u(k) to be a linear function of r(k), 


ulk) = —Kx(k) + Nr(k) (9-88) 


9.7 Systems with Inputs 


where N is a constant to be determined. Then, from (9-86) and (9-88), 


x(k + 1) 


y(k) 


(A — BK)x(k) + BNr(k) 


Cx(k) (9-89) 


Taking the z-transform of these equations and solving for the transfer function yields 


aM is CI — A+ BK) 'BN (9-90) 
R(z) 


Note that the choice of N does not affect the system’s relative frequency response, but only the 
amplitude of the frequency response; the transfer function is independent of N except as a mul- 
tiplying factor. 

A special case is worth noting. For the case that the output is a state, which we can call 
x(t) without loss of generality, we can write the output equation as 


y(k) = Cx(k) = [10 +++ O}x(k) = x(k) 


The equation for u(k) can now be expressed as a function of the system error, which is 
e(k) = r(k) — y(k). From (9-88), we let N = K,, and 


ulk) = —Kx(k) + Kir(k) 


Ky[r(k) = yW] = Kalk) = + = Ryn) (9-91) 


Thus the control is a function of the system error, as was the case for classical control design. 
The system block diagram for this case is given in Fig. 9-12. This system is investigated further 
in Example 9.12. 

It is informative to determine the zeros of the system transfer function, (9-90). To locate 
the zeros, consider the z-transform of (9-89). 


(zl — A + BK)X(z) — BNR(z) = 0 


CX(z) = ¥z) (9-92) 
Plant 
r(k) u(k) n [axo 
irt = K, i =| G(z) ———————_ > 

Other 
states 

Other |, 

gains 

[Kax (k) +: ++ K,x,(K)] 


FIGURE 9-12 System with input. 
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If z = z is a zero of the transfer function, (9-90), then Y(zo) is zero with R(zo) and X(zp) non- 
zero. Hence we can express (9-92) as 


zl — A + BK Palen Sö (9-93) 


C 0 R(Z) 


This equation has a nontrivial solution, since R(z)) and X(z) are not zero. Hence the determinant 
of the coefficient matrix, which is a polynomial in Zp, must be zero [7]. The roots of this polyno- 
mial are then the zeros of the system transfer function. 
The locations of the zeros of the transfer function are not evident from (9-93). However, 
we can rewrite (9-93) as 
= -A all X) = 0-94) 
C 0 JLNR(z) — KX(zo) 


Here the coefficient matrix is independent of K and N, and is, in fact, that of the plant alone. 
Hence the zeros of the closed-loop transfer function are the same as those of the transfer function 
of the plant and cannot be changed by the design procedure. This design procedure is then of 
limited value. An example illustrating this design procedure will now be given. 


EXAMPLE 9.12 


The system of Example 9.1 will again be considered, but with an input added as in (9-88). For 
this system the plant state equations are given by 


We i e RA be 


0 0.904837 0.0951630 
yW = [1 O}x(k) 


The design in Example 9.1 resulted in the gain matrix 


K = [4.212 1.112] 


Hence 
0.0048374 0.0204 0.0054 
BK = [4.212 1.112] = 
0.095 1630 0.4008 0.1058 
Then 
z — 0.9796 —0.0898 
zI — A+ BK = 
0.4008 z — 0.7990 
and 


(Il — A+ BK)! = 


1 i — 0.7990 a 
z? — 1.7786z + 0.8187 —0.4008 z — 0.9796 


9.7 Systems with Inputs 
The system transfer function is given by (9-90): 


Y 0.004837(z + 0.9672)N 
YO _ Cg- A + BK)'BN = @ ) 


R(z) z? — 1.7786z + 0.8187 


Note that the system dc gain is given by 


KO 


= 0.2373N 
R(z) z=1 


The dc gain can be increased by the choice of N. Since y(k) = x(k), we can choose N = K; 
as in (9-91), and the control will be a function of the error between the input and the output. 
Since K, = 4.212, the dc gain is now unity; the system shown in the inner loop of Fig. 9-12 is 
type 1. The step response for this case is shown in Fig. 9-13, and the steady-state error is zero. 
MATLAB code for this example follows. 


% Append this code to that of Example 9.3 

syms z 

N=1; Tz=C*inv(z*eye(2)-A+B*K)*B*N; % Equation (9-90) 
(num, den] =nice(Tz,z); 

Tz=t£ (num, den, -1) 


We will now consider the case that a prediction observer is used to implement the control 
system. The plant is described by 


x(k + 1) = Ax(k) + Bu(k) 
y(k) = Cx(k) (9-95) 


and the observer, from (9-38), is described by 
[eq. (9-38)] q(k + 1) = (A — GO)q(k) + Gy(k) + Bulk) 
The control is implemented by 


ulk) = -Kq (k) (9-96) 


yA) A 


0:5 


FIGURE 9-13 Step response for Example 9.12. 
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To be general, we can allow the input to enter both (9-38) and (9-96). These equations become 


qk + 1) (A — GC)q(k) + Gy(k) + Buck) + Mr(k) (9-97) 


u(k) 


—Kq(k) + Nr(k) (9-98) 


The design problem then is to choose M and N so as to achieve certain design objectives, such as 
zeros of the system transfer function, steady-state errors, and so on. 
We will consider the case that only the error 


e(t) = rt) — yd) (9-99) 


is measured, and thus only this signal is available for control. For example, in radar tracking 
systems, the radar return indicates only the error e(t) between the antenna pointing direction and 
the direction to the target. The error-control condition can be satisfied in (9-97) and (9-98) by 
choosing N to be zero and M equal to —G. Then (9-97) and (9-98) become, respectively, 


q(k + 1) = (A — GO)q(k) + Gly’ — r(k)] + Bulk) (9-100) 
ulk) = —Kq(k) (9-101) 


Note that this design procedure also gives no choice in the selection of the system transfer- 
function zeros. An example will now be given to illustrate this design technique. 


EXAMPLE 9.13 


The system of Example 9.12 will be considered, with the observer designed in Example 9.3 to be 
employed. The plant state equations are given in Example 9.12. The gain matrices for the con- 
troller and for the observer are given in Example 9.3. The required matrices are then 


1 0.09516 0.00484 
A= , = > c= 0 
0 0.90484 0.09516 
0.2674 
K = [4.2124 1.111 = 
l dI G ped 


Substitution of these matrices into (9-100) and (9-101), and then substitution of (9-101) 

into (9-100), yields the observer equations 
0.7122 0.0898 
—0.4788 0.7990 


0.2674 


PES 
aed) 0.0779 


Jaw a | [bw — r(k)] 


Note that no design is required beyond that performed in Example 9.3. The system block dia- 
gram is given in Fig. 9-14. In this block diagram, the controller transfer function is as calculated 
in Example 9.4, and it is assumed that the input r(kT) is calculated in the computer (as is usually 
the case). Step responses for this design are given in Fig. 9-15. For the response shown by the 
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FIGURE 9-14 System for Example 9.13. 
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FIGURE 9-15 Responses for the system of Example 9.13. 


solid line, the initial conditions of both the plant and the observer are all zero. For the response 
shown by the dashed line, the initial conditions are given by 


_ [-0.5 _ fo 
x(0) = | 0 q0) = H 


For this design procedure, the transient response appears satisfactory; in addition, the 
steady-state error is zero. 


9.8 SUMMARY 


In this chapter a design technique has been presented which is based on the state model of the 
system, compared to the design methods of Chapter 8, which are based on transfer functions. 
The design technique presented is the pole-assignment, or pole-placement, technique. This tech- 
nique allows us to place all the zeros of the system characteristic equation at desirable locations; 
however, the technique requires that all the system states be known, a condition that at least is 
generally impractical. To circumvent this condition, an observer is constructed. An observer 
estimates the system states, based on the known system inputs and the outputs that can be mea- 
sured. Then, for the pole-placement design, the estimated states, rather than the actual states, are 
used to calculate feedback signals. 
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The design above results in a regulator control system, that is, a control system with no 
reference input. A method was presented which modifies the pole-placement design for systems 
that have reference inputs. For the case that the system error is to be used in the control of the 
system, the modifications required are simple and straightforward. 

A problem with observer-based design is that the relative-stability margins at the plant 
input may not be adequate. This problem can be acute, since the main weakness of analytical 
design is the inaccuracy of the linear plant model used in the design. In general, a physical 
system is not linear, and the system’s characteristics vary with time, temperature, and so on. 
Hence an adequate margin of safety is needed, and the relative stability is a measure of that 
safety margin. In the designs presented in this chapter, the frequency response of the open- 
loop function of the closed-loop system must be calculated, to ensure that the system has good 


stability margins. 


References and Further Readings 


[1] 


[2] 


[3] 


[4] 
[5] 


[6] 


J. E. Ackermann, “Der Entwurf linearer Rege- 
lungssysteme im Zustandsraum,” Regelungstech 
Process-Datenverarb., 7, pp. 297—300, 1972. 

G. F. Franklin, J. D. Powell, and M. Workman, 
Digital Control of Dynamic Systems, 3rd ed. Half 
Moon Bay, CA: Ellis-Kagle Press, 2006. 

D. G. Luenberger, “An Introduction to Observers,” 
IEEE Trans. Autom. Control, AC-16, pp. 596—602, 
1971. 

Part II, IEEE Trans. Autom. Control, AC-26, 
1981. 

P. S. Maybeck, Stochastic Models, Estimation and 
Control, Vol. 3. New York: Academic Press, Inc., 
1982. 

J. O’Reilly, Observers for Linear Systems. 
London: Academic Press, Inc. (London) Ltd., 
1983. 


Problems 


9.2-1. 


9.2-2. 


[7] 


[8] 


[9] 


[10] 


[11] 


P. M. De Russo, R. J. Roy, C. M. Close, and A. 
A. Desrochers, State Variables for Engineers, 2nd 
ed. New York: John Wiley & Sons, Inc., 1998. 

J. C. Williams and S. K. Mitter, “Controllability, 
Observability, Pole Allocation, and State 
Reconstruction,” IEEE Trans. Autom. Control, 
AC-16, pp. 582-602, 1971. 

W. M. Wonham, “On Pole Assignment in Multi- 
input Controllable Linear Systems,” IEEE Trans. 
Autom. Control, AC-12, pp. 660—665, 1967. 

C. T. Leondes and L. M. Novak, “Reduced-Order 
Observers for Linear Discrete-Time Systems,” 
IEEE Trans. Autom. Control, AC-19, pp. 42—46, 
1974. 

R. F. Wilson, “An Observer Based Aircraft 
Automatic Landing System,” M.S. thesis, 
Auburn University, Auburn, AL, 1981. 


The plant of Example 9.1 has the state equations given (9-1). Find the gain matrix K required to realize the 


closed-loop characteristic equation with zeros which have a damping ratio ¢ of 0.46 and a time constant T 


of 0.5 s. Use pole-assignment design. 


Consider the plant of Problem 9.2-1, which has the transfer function, from Example 9.5, 


0.00484z + 0.00468 


=] 
Go =< i 
z 


ss + =| 


z? — 1.905z + 0.905 


(a) Using the pole-assignment design, find the gain matrix K required to realize the closed-loop character- 
istic equation with zeros that have the damping ratio ¢ = 0.707 and the time constant tT = 0.8 s. 

(b) To verify the design, show that (9-15) yields the desired closed-loop characteristic equation. 

(c) Draw a flow graph of the form of Fig. 4-20 for the plant. Then add the feedback gains of part (a). 
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(d) Write the state equations for the flow graph of part (c), to verify the system matrix (A — BK) found in 
part (b). 

(e) Find all loop gains in the flow graph of part (c). Then use Mason’s formula to verify that the flow graph 
of part (c) has the characteristic equation of parts (a) and (b). 


A chamber temperature control system is modeled as shown in Fig. P9.2-3. This system is described in 
Problem 1.6-1. For this problem, ignore the disturbance input, T = 0.6 s, and let D(z) = 1. It was shown 
in Problem 6.2-4 that 
z—1 2 0.04147 
(0.04) 3 = 
Z s(s + 0.5) z — 0.7408 
Note that the sensor gain is included in this transfer function. 
(a) Draw a flow graph of the plant and sensor. Write the state equations with the state variable x(k) equal to 
the system output and the output y(k) equal to the sensor output. 
(b) Find the time constant t for this closed-loop system. 
(c) Using pole-placement design, find the gain K that yield the closed-loop time constant t = 1 s. Note 
that the sensor gain does not enter these calculations. 
(d) Show that the gain K in part (b) yields the desired closed-loop characteristic equation, using (9-15). 
(e) Draw a block diagram for the system that includes the sensor. Let the digital computer realize a gain, 
K,, such that the closed-loop time constant is as given in part (b). The sensor in this system must have 
the gain given. 
(f) Using the characteristic equation for the block diagram of part (e), 
1+ K,G(z)H = 0 
verify that this block diagram yields the desired characteristic equation. 
Chamber 
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FIGURE P9.2-3 Chamber temperature control system. 


9.2-4. 


A satellite control system is modeled as shown in Fig. P9.2-4. This system is described in Problem 1.4-1. 
For this problem, let D(z) = 1. In addition, K = 1, T = 1s, J = 4, and H, = 1. From the z-transform 
tables, 


z—- 1 [4|-“e 
4433 


z -1° 
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R(s) 
r(t) 


FIGURE 


9.3-1. 


9.3-2. 


9.3-3. 


A state model for this system is given by 


1 1 0.125 
x(k + 1) = È kw + Re w 


yk) = [1 Olx 


where x(k) is angular position and x2(k) is angular velocity. 

(a) Show that the closed-loop system is unstable. 

(b) Using pole-placement design, find the gain matrix K that yields the closed-loop damping ratio 
¢ = 0.707 and the time constant T = 4s. 

(c) Show that the gain matrix K in part (b) yields the desired closed-loop characteristic equation, using (9-15). 


Digital Amplifier and 
controller thrustors Satellite 
+ Ms) Ts) 1 O(s) 
A/D -——* D(z) -——| D/A + K >| 7 > 
Torque Js 0(0) 
Sensor 


H, l< 


P9.2-4 Block diagram for a satellite control system. 


Consider the pole-placement design of Problem 9.2-2. 

(a) Design a predictor observer for this system, with the time constant equal to one-half the value of 
Problem 9.2-2(a) and with the observer critically damped. 

(b) To check the results of part (a), use (9-46) to show that these results yield the desired observer charac- 
teristic equation. 

(c) Find the control-observer transfer function D,,.(z) in Fig. 9-8. Use control gain matrix of Problem 9.2-2(a). 

(d) The characteristic equation of the closed-loop system of Fig. 9-8 is given by 


1 + D.(Z)G(z) = 0 


Use G(z) as given and D,,(z) in part (c) to show that this equation yields the same characteristic equation 
as a(z)a(z) = 0 
Consider the chamber temperature control system of Problem 9.2-3. 
(a) Design a predictor observer for this system, with the time constant equal to one-half the value of 
Problem 9.2-3(b). 
(b) To check the results of part (a), use (9-46) to show that these results yield the desired observer charac- 
teristic equation. 
(c) Find the control-observer transfer function D,,(z) in Fig. 9-8. Use the value of control gain of Problem 
9.2-3(b). Do not include the sensor gain in D,,(z). 
(d) Draw a block diagram of the system in part (b), with D(z) in Fig. P9.2-3 equal to D.,(z). 
(e) Verify the system characteristic equation using the block diagram in part (d). 
(f) What would be the effect of designing a reduced-order estimator for this system? 
Consider the satellite control system of Problem 9.2-4. 
(a) Design a predictor observer for this system, with the time constant equal to one-half the value of 
Problem 9.2-4(b) and with the observer critically damped. 


9.3-4. 


9.3-5. 


9.4-1. 


9.4-2. 


9.4-3. 
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(b) To check the results of part (a), use (9-46) to show that these results yield the desired observer charac- 
teristic equation. 

(c) Find the control-observer transfer function D,,(z) in Fig. 9-8. Use the control gain matrix of Problem 
9.2-4(b), K = [0.3893 1.769]. 

(d) The characteristic equation of the closed-loop system of Fig. 9-8 is given by 


1 + D.(z)G(z) = 0 


Use G(z) as given and D,,(z) in part (c) to show that this equation yields the same characteristic equation 
as a(z)a,(z) = 0 

Assume that equation (9-25), Ackermann’s formula for pole-assignment design, is the solution of (9-15). 

Based on this result, show that (9-48), Ackermann’s formula for observer design, is the solution of (9-46). 

Given in (9-56) is the closed-loop state model for the pole-placement prediction-estimator design. Extend 

this model to include plant disturbances and sensor noise, as described in (9-44). 

Consider the control system of Problem 9.2-2. 

(a) Design a reduced-order observer for this system with the time constant equal to one-half the value of 
Problem 9.2-2(a). 

(b) To check the results of part (a), use (9-63) to show that these results yield the desired observer charac- 
teristic equation. 

(c) Find the control-observer transfer function D,,(z) in Fig. 9-8. Use the control gain matrix of 
Problem 9.2-2(a). 

(d) The characteristic equation of the closed-loop system of Fig. 9-8 is given by 


1 + D,.(zZ)G(z) = 0 


Use G(z) as given and D,,(z) in part (c) to show that this equation yields the same characteristic equation 
as a(z)a(z) = 0 

Consider the satellite control system of Problem 9.2-4. 

(a) Design a reduced-order observer for this system, with the time constant equal to one-half the value of 
Problem 9.2-4(b). 

(b) To check the results of part (a), use (9-63) to show that these results yield the desired observer charac- 
teristic equation. 

(c) Find the control-observer transfer function D,.(z) in Fig. 9-8. Use the control gain matrix of Problem 
9.2-4(b), K = [0.3893 1.769]. 

(d) The characteristic equation of the closed-loop system of Fig. 9-8 is given by 


1 + DelZ)G(z) = 0 


Use G(z) as given and D,,(z) in part (c) to show that this equation yields the same characteristic equation 
as a(z)a(z) = 0. 
Consider the reduced-order observer designed in Problem 9.4-2. In this problem, velocity [dy/dt] is esti- 
mated, using position [y] plus other information. We could simply calculate velocity, using one of the 
numerical differentiators described in Section 8.8. This calculated velocity would then replace the estimate 
of velocity in the control system. (This is the approach taken in the PID controller.) 
(a) Consider the plant observer as an open-loop system, as shown in Fig. 9-4. Calculate the transfer function 
Q(z)/Y(z) with U(z) = 0, where q(kT) is the observer estimate of velocity. Hint: Use (9-62) with u(k) = 0. 
(b) Plot the Bode diagram for the transfer function in part (a) versus w,,. 
(c) One numerical differentiator given in Section 8.8 is 


y= 
Tz 


DR) = 


Plot the Bode diagram for this transfer function on the same graph as in part (b). 
(d) Comment on the similarities and differences in the two frequency responses. 
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9.5-1. 
9.5-2. 


9.5-3 


9.5-4. 


9.5-5. 
9.5-6. 


9.5-7. 
9.6-1. 


9.6-2. 


9.6-3. 


9.6-4. 
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Consider that in Fig. 9-8, the observer is reduced order, and that the system is single-input single-output. 

Show that the transfer function D,,(z) of the equivalent controller is given by (9-66). 

Repeat all parts of Problem 9.3-1 using a current observer. 

Repeat all parts of Problem 9.3-2, using a current observer. 

(a) Find the closed-loop state equations for the system of Problem 9.3-2(a), of the form of (9-56). 

(b) Find the system characteristic equation using the results in part (a), and show that this is the desired 
equation. 

(c) Repeat parts (a) and (b) for the closed-loop system of Problem 9.5-2. 

Consider the chamber temperature control system of Fig. P9.2-3. For this problem, replace the sensor gain 

H = 0.04 with the gain H = 1. The system is now a unity-gain feedback system. 

(a) Work Problem 9.2-3 with H = 1. 

(b) Work Problem 9.3-2 with H = 1. 

(c) Work Problem 9.5-2 with H = 1. 

(d) Work Problem 9.5-3 with H = 1. 

Repeat all parts of Problem 9.3-3, using a current observer. 

(a) Show that for the current observer specified in Section 9.5, the transfer matrix from the input U(z) 
to the estimated states Q(z) is equal to that from the input to the states X(z); that is, show that 
Q(zZ/U(z) = X(z)/U(z). 

(b) Show that for the current observer specified in Section 9.5, the transfer function of the control-observer 
combination of Fig. 9-8 is given by (9-73), which is 


D(z) = zK[zl - A + GCA + BK — GCBK]'!G 


Derive the closed-loop state model for the pole-placement current-estimator design, given in (9-74). 
Consider a system described by (9-82). 


x(k + 1) = Ax(k) + Buk) 
y(k) = Cx(k) 


For the case that u(k) is not zero, derive the conditions for observability. 
Consider the plant of Example 9.2, which is 


1 0.0952 00484 
0.095 kw nl Bes 8 


eye 
ae} p 0.9048 0.0952 


| u(k) 


Suppose that the output is given by 
yk) = [0 1)x(k) 


(a) Is this system observable? 

(b) Explain the reason for your answer in part (a) in terms of the physical aspects of the system. 

Consider the satellite control system of Problem 9.2-4. Suppose that the output is the measurement of angu- 
lar velocity, such that 


yk) = [0 1)x(k) 


(a) Is this system observable? 

(b) Explain your answer in part (a) in terms of the physical aspects of the system. We are attempting to 
estimate position, given velocity. 

Consider the temperature control system of Problem 9.2-3. 

(a) Determine if this system is controllable. 

(b) An observer is added to this system in Problem 9.3-2, with the equation [see (9-38)] 


gk + 1) = (A — GC)q(k) + Gy(k) + Bulk) 
= 0.3012g9(k) + 10.99y(k) + 1.0368u(k) 


9.6-5. 


9.6-6. 
9.6-7. 


9.6-8. 
9.7-1. 


9.7-2. 
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Construct a single set of state equations for the plant-observer system, with the state vector [x(k) q(k)]" 
and the input u(&) (i.e., there is no feedback). 

(c) Show that this plant—observer system is uncontrollable. 

(d) Based on the results of part (a), which state is uncontrollable? 

Consider the first-order plant described by 


x(k + 1) = Px(k) + Qu(k) 
y(k) = Rx(k) 


and a prediction observer described by (9-38). 

(a) Construct a single set of state equations for the plant—observer system, with the state vector [x(k) (k) 
and the input u(k) (i.e., there is no feedback). 

(b) Show that this system is always uncontrollable, regardless of the value of observer gain G. 

Repeat Problem 9.6-5 for the current observer. 

For the system of Problem 9.6-5, use a transfer function approach to show that the transfer function 

Q(z)/U(z) is first order (even though the system is second order) and is equal to X(z)/U(z). Hence the mode 

of Q(z), which is (A — GCY*, is not excited by the input signal u(k). 

Problem 9.6-7 is to be repeated for the current observer, with the mode of Q(z) equal to (P — GRP)‘. 

In Problem 9.2-4, a pole-placement design for a satellite control system results in the gain matrix 

K = [0.194 0.88]. It is desired to have an input signal r(t) applied to the system, so as to realize the sys- 

tem of Fig. 9-12. Write the resulting state equations in the form 


" 


x(k + 1) = A,x(k) + Byr(k) 


y(k) = Cyx(k) 
: t 1 1 0.125 0.375 
Evaluate all matrices with A = ,B = , and AB = 
0 1 0.25 0.25 


Repeat Problem 9.7-1 for the temperature control system of Problem 9.2-3, where the state equations are 
given by 


x(k + 1) = 0.2402x(k) + 1.2343u(k) 
y(k) = 0.07x(k) 


and where the control gain is K = 0.3652. 
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System Identification 
of Discrete-Time Systems 


10.1 INTRODUCTION 


System identification is defined as the process of constructing the mathematical model of a sys- 
tem from a judicious combination of the measurements of its outputs and possibly some inputs, 
if any. System identification becomes particularly important when one does not know the exact 
physical law describing the underlying operating principles of a system, which is often the case 
with many engineering systems as well as systems that exist in nature. For example, one may not 
know the exact mathematical relationship between the angle by which a robot may turn when an 
external disturbance torque is applied on it while it is performing a given task. This information 
may, in fact, be crucial for designing the robot itself so that it can sustain the worst-case turns 
under adversarial conditions during a mission. One way to solve this problem would be to apply 
various torques of increasing magnitude to the robot, measure the respective turn angles using 
sophisticated motion sensors, and then apply system identification techniques using the input 
(torque) and output (turn angle) measurements to derive a mathematical relationship between the 
two. The derived relationship can, thereafter, be used to predict the angle by which the robot may 
turn if any torque is applied. It can also be used to design appropriate controllers so that the robot 
survives the worst-case torque. 

The complexity of system identification techniques often depends on how much prior 
knowledge one has about the system under study. For example, one may have very limited 
or almost no knowledge of how a given system works, or what may be the laws of physics 
governing its internal principles, or what may be a possible order of its dynamics, in which 
case the identification is referred to as unstructured or black-box identification. Depending 
on circumstances, however, sometimes the user may know several pieces of prior informa- 
tion about the system that may be helpful in identifying it. For example, given two different 
robots, we know a priori that both of their motions are dictated by Newton’s laws, which 
helps us in visualizing a structured form of their mathematical models, but we may not know 
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the actual values of their respective inertias or time constants. Such cases are referred to 
as structured, or grey-box identification, indicating that the search for the perfect model is 
not totally unguided. Grey-box identification is often alternatively referred to as parameter 
estimation, meaning that the overall structure of the model may be known but the model 
parameters are not known, and need to be estimated from measurements of inputs and out- 
puts. Once a reliable mathematical model of the system is identified, it can be used for both 
prediction and control. 

In this chapter we will describe several system identification techniques for discrete-time 
static and dynamic systems. For simplicity, we will limit our discussion only to linear time- 
invariant (LTI) systems, although there exists a rich research literature of identification of 
nonlinear systems too. We will first describe methods for constructing algebraic functions for 
unknown static systems. Thereafter, we will present methods to identify state-variable models 
(identification in time domain) and transfer function models (identification in frequency domain) 
for dynamic systems using input and output measurements. An interesting point to note in this 
context is that identification, especially the identification of dynamic systems, is quite an open- 
ended problem as one can always add an uncountable number of fast poles or zeros to an iden- 
tified model while preserving its input and output trajectories to nearly the same as originally 
measured, and thereby make the model non-unique. The identification methods described in 
this chapter are, therefore, meant to identify the simplest possible models that match the input 
and output measurements without any further pole—zero cancellations in their transfer functions. 
Another important factor dictating the accuracy of these techniques is the right choice of sam- 
pling interval. If the outputs, for example, are sampled too slowly then they may not capture 
all the important features of the transient responses of its state variables, and thereby produce 
an incorrect model. Depending on the time constant of the system, one, therefore, must ensure 
that the sampling rate is high enough to capture the contribution of all the poles and zeros in the 
measured output. 


10.2 IDENTIFICATION OF STATIC SYSTEMS 


Static systems are systems with no memory. They are modeled by algebraic relationships 
between their inputs u(k) and their outputs y(k), where k denotes sample number. Identification 
of such system models is relatively easier and more straightforward than for dynamic systems. 
A typical approach is to use a parametric dependence between y(k) and nonlinear functions of 
u(k), which are often referred to as basis functions. The model is of the form 


yk) = Bo + Bipul) + Bopa(uk)) + +++ + Brp Uk) (10-1) 


where the coefficients B; are unknown real numbers, ;(u(k)) are known real-valued functions 
of the input u(k), and n > 0 is an integer that defines the functional degree of @,(u(k)). The inte- 
ger n may be known or unknown. The problem is to estimate the constants B; using measured 
values of u(k) and y(k). If the constant n is not known, then a usual approach is to start with a 
guess for n, estimate Bo, Bı, - - -, Bn, and check whether ĵ(k), the output of the identified model, 
matches the measured output y(k) well enough for the same values of the input u(x). If the two 
outputs don’t match well, then one may use a higher value of n and repeat the estimation until a 
reasonable matching is obtained. For a given value of n one way to estimate the parameters B; is 
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to collect all the measured outputs in a matrix y, all B; in a vector B, all ẹọ;(u(k)) in a matrix ®, 
and represent the equation in (10-1) in the following matrix form: 


y(0) 1 pO) pu) «+ pu) ] [ Bo 
y(1) 1 gua) pu) + pUl) || By 
v2) |=] 1 D UD) e u) || Be (10-2) 
y(N) 1 PUND PUN) ++: @,(uiNy | |B, 
y p B 


The number of samples N must be chosen to be much larger than n. This means that the 
matrix ® is a skinny matrix, that is, it has more rows than columns. The unknown parameter 
vector B can then be estimated using the formula 


B = (®'@)'@" y (10-3) 
p+ 


where the matrix ®* is referred to as the Moore-Penrose pseudo-inverse of ®. Yet another 
way to derive the same answer is to pose the problem in the following way. For every sample k, 
define an error term e(k) as 


elk) = y(k) — @ (KB (10-4) 


where y(k) is measured output, and ¢'(k) = [1 (ulk) xulk) °-:: ©, (u(k))]. The 
unknown parameter vector B can then be estimated as a solution of the optimization problem 


B= aremin| S20 (10-5) 
B V= 


The solution of the above problem will be the same as in (10-3), which is often referred to as the 
least-squares solution. The resulting B is referred to as the least square estimate, which is opti- 
mal in the sense of minimizing the sum of the squared error between the theoretical output and 
the measured output as in (10-5). 

A pertinent question to ask at this point is how to choose the basis functions g; in (10-1) for 
any given set of input and output measurements. While the answer depends on how much prior 
information about the system behavior is known, a common practice for identifying many real- 
world applications is to use g; as a polynomial function of the input u(k). For example, choosing 
a degree n, a polynomial approximation of (10-1) is given by 


y(k) = Bo + PBiulk) + BaP (k) + +++ + B,C) + B,wk) (10-6) 


Equation (10-2) in that case takes the special form 
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y(0) 1 uO) O) --- wO) || Bo 

y(1) 1 oud) wd) > wd) |} By 

y(2) |} =] 1 WUD P2) su) |] Be (10-7) 
y(N) 1 uN) N) © NLB, 
——’ ——_—_—_—_—_—_—_—_—_ Aa MMM 

y ® B 


the solution for which follows from (10-3). In MATLAB, the Equation (10-7) can be solved 
for the unknown parameter vector B using the function polyfit. We next cite an example to high- 
light the use of this function for a specific set of input-output measurements. 


EXAMPLE 10.1 


Consider the following data set, where u(k) is the independent variable (input), and y(k) is the 
dependent variable (output) of a static system, for k = 1,2, ..., 10. Find a polynomial fit 
between y(k) and u(k). 


k 1 2 3 4 5 6 T 8 9 10 
uk) 1 2 3 4 5 6 7 8 9 10 
yk) O 100 800 4200 15800 46900 108000 262600 532000 1000700 


5 
ao 1 r 
— Given data 
---n=1 
sa S n=2 
3 n= 3 


FIGURE 10-1 Polynomial fits for input—data data. 
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Using the polyfit function in MATLAB we get the following results for different values of 
the degree n: 

n= 1: yk) = —282260 + 87160u(k) 
2: y(k) = 235870 — 171910u(k) + 23550u?(k) 
n = 3: yk) = —127940 + 150770u(k) — 464104 (k) + 424013(k) 


n 


The three different polynomial fits are shown in Fig. 10-1 along with the actual data. It can be 
seen that the fit for n = 3 fits the actual data fairly closely. 


10.3 IDENTIFICATION OF DYNAMIC SYSTEMS 


While the Least Square method stated in (10-5) gives a reasonably accurate way of identify- 
ing static systems, the problem of identifying dynamic systems is much more complex. For a 
discrete-time LTI system the problem can be posed as follows. Consider the state-variable model 


x(k + 1) = Ax(k) + Bu(k) 
y(k) = Cx(k) + Du(k) 


(10-8) 


where x E€ R”, u E R”, and y € R’, n is the order of the system. The integer n and the four 
matrices A, B, C, and D are unknown. Given N measured samples of y(k) and u(k), possibly 
corrupted with measurement noise, our objective is to estimate n and the four system matrices 
A, B, C, and D up to a similarity transformation. There can be several ways of solving this 
problem, depending on noise levels in the measurements. We next describe one possible way to 
estimate the four matrices, assuming that the measurements do not have any noise. The case for 
noisy measurements can be found in details in [1] and [2]. We first describe the method when 
absolutely no prior information about n and any of the system matrices are known, referred to as 
black-box identification, which is usually approached in time-domain. Thereafter, we revisit the 
least-squares method and describe how it can be used for solving the above problem when the 
number of poles and zeros of the transfer function of (10-8) is known a priori. This problem is 
solved in frequency-domain. 


10.4 BLACK-BOX IDENTIFICATION 


For simplicity of explanation, and without any loss of generality, we will assume (10-8) to be 
a single-input single-output (SISO) system, that is, m = p = 1. We will also assume the input 
u(k) to be of the form 


L k=0 
j= 10-9 
utk) fr k=1,2,...,N ao” 


indicating that the input is a short-lived unit impulse. Since the system in (10-8) is linear, we 
also assume without any loss of generality that the initial value of the state x(k) is zero, that is, 
x(0) = 0. Before proceeding further, we need to make three important assumptions: 


Assumption 1: The LTI system (10-8) is both controllable and observable. 


Assumption 2: The input u(k) is persistently exciting, that is, the signal u(k) is rich 
enough to stir the contribution of all the dominant dynamic modes in the output y(k). 


10.4 Black-Box Identification 


Assumption 3: The intersection of the row space U; (the future inputs) and the row space 
of X, (the past states) is empty. These two matrices for any f and p are defined as follows: 


wO UP WEED: <2 ua F= uG EPH 1H 
HELA HEROD: HERBY ree a P= uli + j) 
II sy aaa E IGET y 
y2i-1) C) yQitl «+ i+j-1) i+j-2 
x(0) x(1) x(2) See x(j — 2) x(j— 1) 
x(1) x(2) x(3) KR xj — 1) x(j) 
x= ; : ; ; : : 
P. xP) PHD XPI) > xptj-2) xp+j-1) 
Gi “Oo BED e itj itj) 


With these three assumptions in place, we next describe a step-by-step method for estimating 
A, B, C, and D in (10-8) using u(k) and y(k), k = 0, 1,2,..., p. The first step is to note that 
since x(0) = 0 and u(0) = 1, from (10-8) we get 


y(0) = Cx(0) + Du(0) = D (10-10) 


This means that the value of the scalar D is simply equal to that of the very first sample of the 
output. We further exploit this fact to find an estimate for A next. From the definition of the 
input, the initial state, and the model (10-8) we note the following pattern: 


y(1) = Cx(1) + Du(1) = C(Ax(0) + Bu(0)) = CB 
y(2) = Cx(2) + Du(2) = C(Ax(1) + Bu(1)) = CAB 
y(3) = Cx(3) + Du(3) = C(Ax(2) + Bu(2)) = CAB 
and so on. In general, we can write 
y(i) = CA 'B (10-11) 


where i = 1, 2,...,p. We next construct a matrix H}, referred to as the Hankel matrix, by gath- 
ering the output samples in the following way: 


yd) (2) y(3) zr yM — 1) y(M) 
y(2) W8) y(4) zr yM) yM + 1) 

H =| oe K p : a fs (10-12) 
y) HED EEJ °: yM+i-2) wM+i-1) 


AN) INED GED © MEN- yM+N-1) 
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The constants M and N may be chosen arbitrarily such that M + N — 1 < p, but both must be 
sufficiently large so that they preserve the order n of the system. Using (10-11) and (10-12), we 
can also write 


CB CAB CAB vee CA“-?B CAY—'B 
CAB CAB CAB vee CA“— |B CA“B 
H, = s E à : < i 10-13 
i CAIB CAB CATR --- CARR CAME 2p ( ) 
CB CAMB: CAR ... (CHIR Can tg 


Inspecting the structure of the matrix on the right-hand side (RHS) of (10-13), it is easy to 
see that H, can also be written as 


H, = OL (10-14) 
where 
O=[C’ (CA) (CA (CADH 
is the observability matrix, and 
L=[B AB AB =- Æ- 'B] 


is the controllability matrix of the system (10-8). Since both M and N are chosen to be signifi- 
cantly larger than n, we next consider the singular value decomposition (SVD) of H; to eliminate 
any unnecessary modes contained in H,. The SVD is of the form 


H, = [U] oaa |e] (10-15) 


where U,, Up, Vj, and V, are unitary matrices, while $}; and $, are square diagonal matrices that 
have the singular values of H,. $}; is chosen such that it has the most dominant nonzero singular 
values along its diagonal, while the diagonal entries of $, are zero or almost zero. These singu- 
lar values are then treated as negligible, and the system order is simply reduced to the dimension 
of 2. Therefore, the value of n is considered to be equal to the number of the diagonal entries 
of È. A reduced-order Hankel matrix is thereafter defined as: 


H, = USV; (10-16) 
From (10-14) and (10-16), we can also easily derive that 
H = OL (10-17) 
where 
O =[C (CA (CA = (CAT 


and 
L=[B AB AB ::: A’ 'B] 


10.4 Black-Box Identification 


are the full-rank n X n observability and controllability matrices, respectively. Equation (10-16) 
can also be written as: 


H, = Ul322V, = (270)"(27V) (10-18) 

Then using Assumption 3 it can be shown from (10-17) and (10-18) that the following is true: 
© = (220,)" (10-19) 
L = 5V; (10-20) 


Since the value of n is already known, we next construct another Hankel matrix of the fol- 
lowing form: 


y(2) y(3) y(4) ae y(n) y(n + 1) 
y(3) y(4) y(5) aes y(n + 1) y(n + 2) 
H, = B B : a 3 (10-21) 
y(i) yi +1) yi+2) soi yn+i—2) y(n+i-— 1) 
yn +1) ya+2) yn+3) ce: y(2n — 1) y(2n) 
From (10-10) it is easy to see that H, can be written as 
CAB CAB CB >> CA’ 'B CA'B 
CAB CAB CAB -> CA'B CA’*'B 
H=| 5 ‘ : ; 5 $ 10-22 
? | CAB CAB CAB © Cat 2B CAIB he?) 
CAB CA™'B CAB >> CA" PB OCA" 'B 
which, using the definitions of O and L, can also be written as 
H, = OAL (10-23) 
Using (10-19) and (10-20), the above expression can be rewritten as 
H, = (22U,)"A (22V)) (10-24) 
from which an estimate for A can be constructed as 
A = ($U) "H, ($V) (10-25) 


All the matrices on the RHS of (10-25) are known. H, is known as the user creates H, from the 
measured samples of y(k) as in (10-21), while U,, V,, and $; are known from the SVD of the 
known matrix H,. Therefore, (10-25) gives us a possible way of computing A from the knowl- 
edge of u(k) and y(k). 
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Similarly, the matrices C and B can be computed in the following way. We know that 


gso (10-26) 
a 
A, 


where Č is a block diagonal matrix whose diagonal blocks are C. Then using (10-19) and (10-26) 
we can write 


Č = (XUDAT! (10-27) 


Finally, C can be estimated by extracting the first n elements of the first row of C. In a similar 
way, we have 


L= A ... A&B (10-28) 
— amam 
where B is a block diagonal matrix with the diagonal blocks being B. Thus, from (10-20) and 
(10-28) we get 


B = AZ ŒV) (10-29) 


Then B can be estimated by extracting the first n elements of the first column of B. Another 
way to estimate C and B is to extract them directly from the structure of the two matrices O 
and L. The matrix O is known from (10-19) and L is known from (10-20). Therefore, using 
(10-17a), C can simply be extracted as the first row of O, while B can be extracted from the first 
column of L. This is often the easiest way to estimate C and B. In the Example 10.2 we will use 
this approach. 

It must, however, be remembered that state-space identification is never unique, that is, 
the estimates of A, B, C, and D are accurate only up to a similarity transformation of the actual 
state-space model. 


EXAMPLE 10.2 


Consider the following impulse response data for a SISO discrete-time LTI system with 
a sampling time of T = 0.01 s. The output is measured at the sampling time instants 
t = 0, 0.01, 0.02, ... , 0.08, as shown in Fig. 10-2. 


k 0 1 2 3 4 5 6 7 8 
y(k) O 0.996 -0.298 -0.0148 0.0338 -0.0081 -0.0011 0.0011 -0.0002 


Our objective is to identify a similarity transformation of the system matrices A, B, and C, 
and the corresponding transfer function, using the given values of y(k) and with the information 
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0.4 L L L 
0 0.02 0.04 0.06 0.08 


t (s) 
FIGURE 10-2 Measured output y(k) plotted against time. 


that u(k) is an impulse. We use the following MATLAB code to estimate these matrices based on 
the black-box identification algorithm described in Section 10.4. 


T=0.01; 
y=[0;0.996;-0.298;-0.0148;0.0338;-0.0081;-0.0011;0.0011;-0.0002]; 
p=length(y) -1; 
M=p/2; N=M; 
for i=1:N 
for j=1:M 
H1(i,j)=y(itj); 
end 
end; 
{u,s,v]=svd(H1); 
n=2; 
ubar=(u(:,1:n))'; 
sbar=s(1:n,1:n); 
vbar=v(1:n,:); 
for i=1;M 
for j=1:N 
H2 (i,j) =y(it+jt+1); 
end 
end; 
int1= (sqrt (sbar) *ubar)'; 
int2=sqrt (sbar) *vbar; 
Ahat=pinv (intl) *H2*pinv (int2) 
Bhat=int2(:,1) 
Chat=int1(1,:) 
{num1,den1]=ss2tf(Ahat,Bhat,Chat,0) ; 
Ghat=tf (num1,den1,T) 


The singular values of the Hankel matrix H; are shown in Fig. 10-3, from which it is clear that 
the system order n can be well approximated as 2. The identified system matrices are 


a _ | —0.2511 A ao ee 


> Ĉ = [-1.0012 —0. j= 
—0.3010  — 0.0284 ee C = [-1.00 0.0800], 0 
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10° 


1075 beeen A rs ERE ey EESTE i iranti 


Magnitude 


10°19 a aa potesse prenns ; mrenani 


10°15 p------~ proces cae Peretane prerekana E 


10720 H H H 

4 6 8 10 
Index of singular values 
FIGURE 10-3 Singular values of the Hankel matrix H4. 


0 


and the corresponding discrete-time transfer function is 


0.9956z — 0.01955 
z? + 0.2795z + 0.08534 


G(2) = 


The actual system matrices from which the output y(k) is originally generated are 


0 1 0 
ssl EA eal c=) H 


with the actual transfer function being 


Zz 


OD" por 

The identified transfer function is, therefore, almost the same as the actual transfer function. It 
should be noted, however, that the identified state-variable model is not the same as the actual 
state-variable model. They are the similarity transformations of each other, neglecting minor dif- 
ferences due to numerical errors. We next present the following MATLAB code to compare the 
impulse response of the identified system with that of the actual system: 


% Append this code to the program above 

A=[0 1;-.1 -.3]; B=[0;1]; C=[0 1]; D=0; 
sysl=ss(A,B,C,0,T); 

sys2=ss (Ahat,Bhat,Chat,0,T); 

t=[0:T:0.08]; 

stairs (t,impulse(sys1,t),'-k','LineWidth',2); 

hold on;stairs(t,impulse(sys2,t),':k!','LineWidth',2) ; 
stepinfo(sys1), stepinfo(sys2) 


The stepinfo of the two systems are compared below and the step responses are displayed in 
Fig. 10-4. 
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100 


Measured output 


teen Estimated output 


80 


60 


40 


—20 


40 L L L L L L L 
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 


t (s) 
FIGURE 10-4 Measured output versus estimated output. 


Actual System Identified System 
Rise Time: 0 Rise Time: 0 
Settling Time: 0.0400 Settling Time: 0.0400 
Settling Min: 0.6900 Settling Min: 0.6960 
Settling Max: 1 Settling Max: 0.9956 
Overshoot: 40.0000 Overshoot: 39.2168 
Undershoot: 0 Undershoot: 0 
Peak: 1 Peak: 0.9956 
Peak Time: 0.0100 Peak Time: 0.0100 


10.5 LEAST-SQUARES SYSTEM IDENTIFICATION 


In the previous section we presented an algorithm for black-box identification consider- 
ing that no prior information about the model (10-8) is available to the user. In this section 
we will present a variant of the least-squares method introduced in Section 10.2 to identify 
this model when the number of poles and zeros of the transfer function of (10-2) from u(k) 
to y(k) is known. The method is referred to as least-squares system identification. We will 
see that it is a simple extension of least-squares curve fitting. Since the number of poles 
and zeros of (10-8) is known, we assume the system transfer-function model to be of the 
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form (2-51), but here we are changing the coefficient numbering order to make the notation 
easier to follow: 


Y(z) G( ) b ız"! + E * ne Dead + b, 
Z z) = i 
U(z) zZ — az! — +++ — an-z — an 


(10-30) 


where U(z) is the input and Y(z) is the output. Hence the system is described by the difference 
equation 


yk) = ayy(k — 1) + ay(k = 2) + +++ + ay(k = n) 
+ bju(k — 1) + byu(k — 2) + +++ + bulk — n) (10-31) 


This model is often referred to as the autoregressive moving-average (ARMA) model. Our 
objective is to determine the coefficient vector 


0 = (ay an **" ay bi b> ree by (10-32) 


from measurements of the input—output sequences u(k) and y(k). 
To illustrate the procedure, we first consider the first-order case, with 


Y(z) bi 
—— eee, G SS T 
ug “OTz 
Hence, 
y(k) = aywk — 1) + byuk — 1) 
and thus 


y1) = ayy(0) + bıu(0) + e(1) 
y(2) = a(l) + bu) + e(2) 
y(3) = ayy(2) + bıu(2) + e(3) 


where the error terms e(k) occur because of measurement inaccuracies, model inaccuracies, and 
so on. This equation can be expressed in vector-matrix form as 


y2)} =| yd) ul) e(2) 
y3) y2) u(2) e(3) 


which may be expressed as (this notation is explained later) 


y(1) y(0) u(0) e(1) 
ay 
1 


y(3) = F(3)0 + e(3) (10-33) 


We wish then to calculate the coefficient vector @ that will minimize the sum of the squared 
errors between the predicted measurements and the actual measurements. The general procedure 
will now be developed. 


10.5 Least-Squares System Identification 


Consider the nth-order ARMA model 


yk) = ayy(k = 1) + ay(k — 2) + +++ + a(k = n) 


+ bulk — 1) + bulk — 2) + +++ + bulk — n) 
with the set of (M + 1) measurement pairs. 
{u(0), y(O)}, {u(1), yA}, -~ , {UN), WY) } (10-34) 
with N = n. Define the vector f(k) by 
FK) = VED =2 ye Hn ulk- De ulk- n)] (10-35) 


The first error that is a function of only known data measurements is e(n). Then, for the sample 
periods n, n + 1, ...,N, 


y(n) = £70) + eln) 


y(n + 1) = f(n + 10 + e(n + 1) (10-36) 


y(N) = £7(N)0 + e(N) 


where 0 is given in (10-32). Using the notation 


y(n) f(n) e(n) 
Wwa N aol EED. eaa ET aoa 
yN) fN) e(N) 
we can express (10-36) as 
y(N) = F(N)0 + e(N) (10-38) 


In (10-37) and (10-38), y(N) is of order (N — n + 1) X 1, F(N) is (N — n + 1) X 2n, 0 is 
2n X 1, ande(N)is(N — n+ 1) X 1. 
Next the cost function J(@) is defined as the sum of the squared errors: 


N 
JO) = Xek = ee) (10-39) 
k 


=n 


Then, from (10-38) and (10-39), 
J(®) = [y — F0]'[y — F0] = yy — 0’F’y — y’FO + 0’F’FO 
= y'y — 20’F’y + 0’F’FO (10-40) 
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where the notational dependence of the terms on N has been omitted for convenience. Thus the 
value of O that minimizes J(0) satisfies the equation 


xo = —2F’y + 2F’F0 = 0 (10-41) 
Or we may write 
F'F@ = Fy (10-42) 
The least-squares estimate of O is then 
6,5 = [FNE] "FN yN) (10-43) 


provided that the indicated inverse matrix exists. If the input sequence u(k) is persistently excit- 
ing (all system dynamics are sufficiently excited by the input) and if @ is identifiable (the param- 
eters can be uniquely determined from the data) the inverse matrix will exist. 

The structure of (10-43) is somewhat difficult to understand, because of the matrix trans- 
poses. As an example of this structure, consider a second-order system with four data points. 
Then N = 4 and 


yl) yO) ul) ATID 
FAOD =| ID yd) uD D| |y) (10-44) 
YO) yO) u3) u(2) J. Ly) 
Note from (10-37) that the total number of data points is (N + 1), and only the output in the last 


data point is used. 
An example will now be given. 


EXAMPLE 10.3 


Suppose that a first-order system yields the following data: 


k u(k) y(k) 
0 1.0 0 
1 0.75 0.3 
2 0.50 0.225 
The assumed transfer function is 
b a 
Ge) = —, o= | | 
z= ay bi 


Thus 


yk) = ayy(k — 1) + biu(k — 1) = [yk — 1) uk — ofe = £7(k)0 


10.5 Least-Squares System Identification 


From (10-37), since N = 2, 


Eee BH 1 | 


M= o yd) uD) L03 0.75 


Then 


rr =|? 0.3 lle 1 J A 
1 0.75JL0.3 0.75 0.225 1.5625 


and the inverse of this matrix is calculated to be 


17.361 Ea 
—2.5 1 


[FF]! = | 


The least-squares estimate of @ is then, from (10-43), 


17.361 “Ale 0.3 le | 
-2.5 1 |L1 0.75 }1.0.225 


(2 Blt 


Thus the transfer function is identified to be 


6,5 = [F’F]'F’y = | 


0.3 
Co) =- 


with the difference equation 
yk) = 0.3u(k — 1) 


and the measurement data given above is seen to satisfy this difference equation exactly. For 

this example, the measurement data was initially generated from this difference equation. In a 

physical situation, the data would not fit exactly, and in fact the errors e(k) may be quite large. 
In some cases we would like to weight the errors in the form 


J(0) = wen) + win + Den + 1) + +++ + w(N)e?(N) (10-45) 
One common case is to weight the most recent data most heavily. In (10-45), the cost function 
can be expressed as 
N 
J(0) = X whelk) = e(N)WW)e(N) (10-46) 
k=n 


where W(N) is a N X N diagonal matrix with elements w; = w(i + n — 1). If this cost func- 
tion is minimized in the manner described above, the resulting weighted least-squares estimate is 


Owrs = [FN WON)EW)I E NWN) N) (10-47) 
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A weighting term that is commonly used is 


wk) = ay ys 1 (10-48) 


If a is chosen such that a = (1 — y), the weighting is said to be exponential. For y, smaller than 
unity, the most recent data dominates the estimation. As y approaches unity, the more distant 
data has a larger influence. In (10-48), if a = y = 1, the weighting matrix W(V) = I, and 
(10-47) becomes the equation for ordinary least-squares identification (10-43). 


EXAMPLE 10.4 


Consider the input and output data of a LTI system with sampling time T = 0.1 s: 


ulk) yk) 

0 
1.0000 
0.9000 
0.7100 
0.7490 
0.7831 
0.7719 


k 
0 
1 
2 
3 
4 
5 
6 


Sele tele te efe 


We wish to generate the least-squares estimate of the transfer function from the given 
input-output data. For this one may write a simple MATLAB code using the function arx as 
follows. 


y=[0; 1; 0.9; 0.71; 0.749; 0.7831; 0.7719]; 

u=ones (length(y) ,1); 

T=0.1; Ssampling time 

% Create a data object using the measured values of the input 
% vector u and the output vector y 

data = iddata(y,u,T); 


Q 


% Define constants for expected number of poles and zeros 
na=2; % Expected number of poles 

nb=1; % Expected number of zeros 

nk=1; % Expected input time delay 

% Estimate the transfer function coefficients using 

m=arx (data, [na,nb,nk]); 

m.a 

m.b 


Here, the integers na, nb, and nk define the number of poles, zeros, and input delay of the transfer 
function, reliable values for which must be known a priori. Typically, one may choose na to be 
equal to the expected number of poles, nk to be the expected input delay, and nb = na — nk + 1. 
Variable m of arx is a MATLAB object, and returns two different vectors, namely m.a for the 


10.6 Estimating Transfer Functions with Partly Known Poles and Zeros 


denominator polynomial of the transfer function, and m.b for the numerator polynomial, both in 
negative powers of z. The estimated transfer function is given by: 


Yz) _ m.b(1) + m.b(2)z1 + +++ + m.b(nb + nk) "t! 
U(z) m.a(1) + malz! + +++ + malna + Iz" 


with the first coefficient of m.a equal to 1, and the first nk coefficients of m.b equal to 0. For 
this example, the estimated transfer function using the arx function, with na = 2, nb = 1, and 
nk = 1, is obtained as 


m.a= 1.00 Oped 0.2 


This means that the identified transfer function is 


go _ z 


1 +017! +027? 24+012+02 


G(z) = 


which is exactly equal to the actual transfer function from which y(k) was generated. 


10.6 ESTIMATING TRANSFER FUNCTIONS WITH PARTLY 
KNOWN POLES AND ZEROS 


Depending on circumstances, one or more poles or zeros of the transfer function of a system may 
be known [5]. For example, one may know a priori that the process has an integrator, which cor- 
responds to a continuous-time pole at s = 0, and thereby a discrete-time pole atz = 1. Similarly, 
one may know that the system under study has a differentiator, which corresponds to a continuous- 
time zero at s = 0, and thereby a discrete-time zero atz = 1. In that case, one need not waste time 
and computational efforts to estimate these poles and zeros that are already known, and instead 
apply a slightly modified form of (10-43) to estimate only the remaining part of the transfer func- 
tion that is unknown. This can be done simply as follows. Suppose that it is already known that a 
system has a pole atz = à; and a zero atz = M. That means the transfer function of the system is 


z — M— 
GR) = TO) 
Lom Ni 
where G(z) is unknown. Thus one may write 
2 ¥(z 
G(z) = ¥@) 
U(z) 


where Y(z) = (z — d,)¥(z), and U(z) = (z — d»)U(z). In time-domain this means that 
Wk) = yk + 1) — Myk) 
ulk) = u(k + 1) — Mulk) 


Therefore, given the values of u(k) and y(k) for different k, and the values of N; and A», one may 
first generate the corresponding values of u(k) and y(k), and then use these values to identify 
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G(z) via the least-squares method. Once G(z) is identified, the actual transfer function can be 
constructed by multiplying G(z) with (z — \2)/(z — ^). 


EXAMPLE 10.5 


Consider the input and output data of an LTI system: 


k uk) yk) 
01 0 

1 1 1 

2 1 16 

3 1 1.91 
4 1 2066 


It is given that the system has one zero and two poles. One of the poles is atz = 0.5. We wish to 
generate the least-squares estimate of the transfer function from the given input-output data. The 
transfer function can be written as 


t 


eee ee OE E 
aa > e 


which means that we first need to generate y(k) using \; = 0.5. This will naturally reduce the 
total number of output samples for y(k) to 4 (k = 0, 1, 2, 3) and introduces one input delay. To 
identify G(z), the corresponding input values need to be used. For this one may write the follow- 
ing MATLAB code, and compute G(z) using the function arx. 


y=[0; Ts Y 
u=[1; 1; 1 
p=length (y 
lambda=0.5 
for k=1212p-1 

ybar (k) =y (k+1) -lambda*y (k) ; 
end; 

ubar=u(1:p-1); 
data=iddata(ybar',ubar,T) ; 


-6; 1.91; 2.066]; 
i l; 
); T= 


i 


na=1; % The number of remaining poles 
nb=1; % The number of remaining zeroes 
nk=0; % The remaining input delay (zero in this case) 


m=arx (data, [na,nb,nk]); 
m.a 
m.b 


The estimates of the numerator and denominator of m are obtained as 


This means that the identified transfer function G(z) is 


z 1 
G — — 
OS or Od 
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Therefore, the estimate for G(z) is 


FA 
(z — 0.5)(z — 0.1) 


G(z) = 


The actual transfer function from which the output data was generated is exactly the same as that 
estimated. 


10.7 RECURSIVE LEAST-SQUARES SYSTEM IDENTIFICATION 


If all measurements are accumulated and the coefficient vector @ is calculated in (10-47), the 
process is said to be batch least squares. However, (10-47) can be manipulated into a differ- 
ence equation such that the @ vector can be recalculated with each data sample as it arrives; the 
method is then said to be recursive least squares. In this section we derive the defining equations 
for recursive least-squares identification. 

From (10-35) and (10-36), 


yk) = £7(K)0 + elk) 


= [y(k — 1)y(k — 2)... wk — 1)...]0 + e(k) 


Now, from (10-37), 
F(N + 1) = [f(n) --- ANEN + 1)] (10-49) 


We will let the weighting factor be 


w(k) = ay, oy <1 (10-50) 
In (10-47) we manipulate the term 
N+1 
FN + DWN + DEIN + 1) = Sf) a yt E) 
k=n 


N+1 
= Sih ayy" fk) + £(N + Daf"(N +1) (10-51) 
k=n 


yF1(N)W(N)F(N) + E(N + 1) af(N + 1) 


This relatively simple form results from W(N) being diagonal. For convenience the 2n X 2n 
matrix P(k) is defined as 


PK) = [F OWORO (10-52) 
Then, from (10-51) and (10-52), 


P(N + 1) = yP(N) + fN + 1af™N + 1) (10-53) 
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At this step we recall the matrix inversion lemma, which states the following identity: 


(A + BCD)! = A! — A'B(C! + DA'B) DA! (10-54) 
We let the right side of (10-53) be (A + BCD) with the following assignments: 


A = yP|(N), B= f(N + 1), 


10-55 
C =a, D=f'(N + 1) (10:33 


The matrix inverse of (10-52) can then be expressed as 


PN +1)= ZPO) = S POEN + 1) 


1 
x “+ fN + 1) PEN +1)| fN + 1) POW) (10-56) 


Since this equation is valid for any N = n, we have developed a difference equation for P(k). 
Note that the factor in the inverse in (10-47) is scalar, and thus no matrix inversion is required. 
The second factor in the batch equation for 0, (10-47), can be manipulated as 


N+1-n 


ay ; y(n) 
F’Wy = [f(n) --- f(N + 1 i : 
y = [f() ( )] is IN) 
a y(N + 1) 
= yE(N)WIN)y(N) + fN + Day(N + 1) (10-57) 


where each matrix on the left side is defined at the sampling instant N + 1, and only the nonzero 
elements of W(N + 1) are shown. 

The substitution of (10-52), (10-56), and (10-57) into the weighted least-squares solution 
(10-47) yields the following set of difference equations after some manipulations: 


P(N) = [F(N)WN)FW) I! (10-58) 

-1 
L(V + 1) = PWN + 1) Z + fN + 1) JPW + 1) (10-59) 
Ôw (N + 1) = Ôms(N) + LIV + DDN + 1) — £7(N + 1) Oyzs(V)] (10-60) 


PN + 1) = vi =- LIN + DEN + DPW)] (10-61) 


These equations apply for N = n; hence, if N is replaced with k, the difference equations form 
the recursive solution for the weighted least-squares system identification. The solution is started 
by finding P(k) and 0(k) for some values of k. Next the vector f(k + 1) is formed, where 


fk + 1) = Ly) yk — 1) +++ yk = ny ulk) +++ uk = n)" 


10.7 Recursive Least-Squares System Identification 


The next set of measurements are used to form y(k + 1), and Equations (10-59), (10-60), and 
(10-61) are then solved recursively. The initial solution for P(k) from (10-58) requires a matrix 
inversion. For that reason, the initial values of P(k) and @(k) are estimated (not calculated) in 
some computer programs, and several iterations are required before the estimated coefficient 
vector settles to approximately constant values. Although recursive least squares is much faster 
compared with batch least squares for most problems, one disadvantage of the recursive approach 
is that it requires an initial guess for 0. If this initial guess is far from the true value, then it may 
take a large number of iterations to converge. 

Recall that the least-squares identification only gives a “best” fit to the data. However, 
depending on the plant model, the noise level of the measurements, the sampling period, and 
several other practical factors, this “best” fit may turn out to be too inaccurate and thus useless. 
For example, suppose that for a given physical system, accurate modeling requires a second-order 
linear model. If we try to fit the data to a first-order model, the least-squares procedure will yield a 
“best” first-order transfer function whose output matches the measured output in the least-squares 
sense. However, the transfer function will not accurately model the actual physical system. 
Therefore, additional verification is often required once a transfer function is calculated using 
least squares. One such verification is the comparison of the time responses of the physical system 
and the derived model for different sets of inputs. Also, the frequency response of the physical 
system can be measured and compared with the frequency response of the derived model. 

An additional problem with any least-squares procedure is that if one data pair is greatly 
in error, the square of this large error will tend to dominate the sum-of-squared errors. Thus the 
procedure will be heavily weighted to reduce this large error, resulting in a less accurate model. 
For this reason it is generally recommended that any data pairs that obviously do not match the 
remaining data be ignored in some consistent manner. An example of recursive least-squares 
identification will now be given. 


EXAMPLE 10.6 


The data of Example 10.3 will be used to illustrate the ordinary least-squares recursive procedure. 
No weighting of data is employed, anda = y = 1 in(10-58)-(10-61). Suppose that an additional 
data point is taken, with y(3) = 0.15 and u(3) = 0.40. We use the solution in Example 10.2 to 
start the recursive solution; hence n = 1 and N = 2. Thus, from (10-58) and Example 10.2, 


17.361 ea 


B a puidi Sia 
P(N) = PO) = [F DFD] = Be 1 


and 
A OA J0 
O(N) = 02) = pa 


From the data in Example 10.2, 


T = 17.361 [ca 
£7(3)P(2)£(3) = [0.225 osis I 


0.225 
= [2.656 —0.0625 
[ [o 5 


| = 0.5664 
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and 
L(3) = PDO + FOPO! 


= kg a 


4.690 | 
—2.5 1 J|L0.5 


|10.5664} = | 
—0.110 


From (10-60), the estimated coefficient vector, after four data points, is then 


6 wis(3) = Owrs(2) + LYG) — £73) yz5(2)] 


= k | + | Hea sc — [0.225 osio | 
0.3 —0.110 0.3 


= [oal 


Note that since the data is exact in this case, no correction in the coefficient vector results. 


10.8 PRACTICAL FACTORS FOR IDENTIFICATION 


Quite naturally, the accuracy of any system identification method, whether in time-domain using 
black-box algorithms or in frequency-domain using parametric least-squares estimation, depends 
on several practical factors. The three most important factors among them are: 


1. Choice of excitation input u(k) 
2. Choice of sampling frequency 
3. Proper scaling of input and output signals 


We next briefly explain how these three factors decide the accuracy of identified models as 
compared to the actual real-world physical model of a system. 


Choice of Input 


As explained in [5], the quality of both black-box identification and least-squares depends sig- 
nificantly on the input u(k). In order to guarantee a reasonably good estimate of the actual model, 
the system must be excited by a sufficiently “rich” input, so that all the underlying physical prop- 
erties of the system get reflected in the output. An easy way to think of this is as follows. Say, 
we take a glass of water and mix some sand in it. Then we take a fraction of the volume of that 
water, and try to estimate the amount of sand poured. If we don’t shake the glass well (equivalent 
to exciting the system with a persistent input), then all the sand will settle down at the bottom 
of the glass, and the sample may not even have any sand left to give us a proper indication of 
how much sand was poured into the glass. The choice of the input, therefore, plays a critical role 
in determining whether identification will lead to a reliable model or not. At the least, the input 
must have the following properties: 


1. The input should be sufficiently rich or persistently exciting, as indicated in Assumption 2 
in Section 10.4. In other words, the input must be dominant enough to guarantee that the matrix 
FT(N)E(N) is well-conditioned and invertible to satisfy (10-43). For example, unimodal sinu- 
soids should be avoided as inputs because a sinusoid of frequency à will not allow us to distin- 
guish between different transfer functions with exactly the same value at the point z = e/*. Good 
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inputs include square-waves, the sum of many sinusoids, or a chirp signal (i.e., a signal with time- 
varying frequency), impulsive inputs, and the like. 


2. The input must be strong enough to produce an output that has high signal-to-noise ratio 
(SNR) [7]. In particular, large inputs are needed when one wants to probe the system at frequencies 
for which the noise is large. However, when the process is nonlinear but is being approximated by a 
linear model, large inputs may be problematic because the linearization may not be valid. As shown 
in [5], there is usually an “optimal” input level that needs to be determined by trial-and-error. As an 
alternative, nonlinear filtering and stochastic parameter estimation using Cramer—Rao bounds may 
also be used [7]. Those techniques, however, are beyond the scope of this chapter. 


3. Since most engineering systems operate in a closed loop, that is, under the influence 
of some feedback controller, the excitation input should be representative of the class of inputs 
that are expected to appear in the feedback loop. In other words, the input should have strong 
components in the range of frequencies at which the system will operate. 


4. An interesting point to note in this context is that in many engineered systems, espe- 
cially in safety-critical systems such as power systems, aircrafts, robotic vehicles, etc., the user 
may not have complete freedom of choosing an excitation input for identifying the system 
model. For example, one may wish to identify the dynamic model of the power grid encompass- 
ing the entire North America, but for obvious reasons of safety and security, one will never have 
complete freedom to inject large input signals into the grid lest that brings down the regular nor- 
mal operations of the system. In such cases, the user often has to depend on natural disturbance 
inputs, such as faults and failures, and implicitly assume their impacts on the measured output to 
be strong enough for successful identification. Another obstacle in such cases is that it may not 
always be possible to model the fault precisely in the form of a regular mathematical function, 
such as step, square wave, or impulse. Therefore, a popular technique that is often used is to 
identify such systems through “output-only” identification methods, where the estimated model 
parameters are completely decoupled from the input information [8]. 


Choice of Sampling Frequency 


Choosing the right sampling frequency is equally important, especially in terms of quantiza- 
tion errors. If the sampling is too fast, then the output values are too close to each other and 
their difference may, in fact, become smaller than one quantization level of the analog-to-digital 
converter (ADC). As shown in [5], the pattern of the output values that appear in solving the 
least-squares estimate (10-43) is mostly determined by the dynamics of the ADC, while the 
least-squares model may have very small amount of information about the system dynamics. 

When the sampling interval is increased, the difference between the consecutive output 
values increases and eventually dominates the quantization noise. In practice, one should choose 
a sampling rate that is large enough so that the Tustin transformation is valid but sufficiently 
small so that the quantization noise does not dominate. A good rule of thumb is to sample, if 
practical, the system at a frequency 20—40 times larger than the desired closed-loop bandwidth 
for the system [5]. 


Choice of Signal Scaling 


Scaling the input u(k) and output y(k) properly is another deciding factor for numerical accuracy 
of an identification algorithm, especially for the least-squares method. For example, in some sys- 
tems the magnitude of the measured output may be unusually large or unusually small depending 
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on the units in which they are being measured. Such large or small values may affect the well- 
posedness and the numerical stability of the matrix inverse operation in (10-43). If very small 
values are used, then any typical software program will approximate them by eliminating figures 
after decimal points, which may reduce the information reflected about the system behavior on 
the output. To maintain compatibility of units between the input and output data, it is, therefore, 
best to normalize the values of u(k) and output y(k) by dividing or multiplying their actual values 
by the same normalization constant. One can, for example, choose the normalization constant 
such that all input and output measurements lie in the same range, for example. in the interval 
[-1, 1]. 


10.9 SUMMARY 


In this chapter we presented some basic results on discrete-time system identification using input 
and output measurements. Black-box identification algorithms were presented in time-domain 
for state-variable models whose order and modeling matrices are completely unknown. Next, 
least-squares system identification was developed for models whose order and structure may be 
known to some extent but the model parameters are all unknown. Implementation of the least- 
squares algorithm in both batch and recursive ways were described. All of these identification 
methods are well suited to computer implementation, and can be very effective tools for creating 
data-based models for prediction, state estimation, and control. 
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10.2-1. Suppose that a square-law circuit has the input—output relationship 


where x is the input voltage and y is the output voltage. 


y = ke 


(a) Derive a least-squares procedure for calculating k, similar to the procedure developed in Section 10.2. 
(b) Experimentation with the circuit yields the following data pairs: 


10.2-2. 


10.2-3. 


10.2-4. 


10.4-1. 


10.4-2. 


10.4-3. 


10.4-4. 


10.4-5. 
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k x Y 
1 0 0.01 
2 1.0 1.01 
3 2.0 3.98 


Find the least-squares value for k for these data. 

(c) To illustrate the effects of erroneous data, suppose that an additional data point, x = 1.5 and y = 3.30, 
is taken. From part (b) we know that for x = 1.5, y should be approximately 2.25. Hence the addi- 
tional data point is erroneous, assuming that the data in part (b) are accurate. Find the percent error in 
Ê using the four data pairs, as compared to the value calculated in part (b). 

Equation (10-5) gives a least-squares estimate for curve fitting. This equation was derived by finding the 

point at which the slope of the cost function is zero. The maximum of a function also occurs at the point at 

which the slope is zero. Show that (10-5) is a minimum, not a maximum, of the cost function. 

Consider the sinusoidal function y(k) = sin (10k) for k = 0,1,...,9. Find the minimum degree of the 

polynomial which fits this function with a maximum least-squares error of 107°. 

In Equation (10-7), show that if N < n then the solution of B is non-unique. For the example in Problem 

10.2-3, calculate the error bound when the polynomial order n is exactly equal to the number of samples 

N = 10. 

Using the data given in Problem 10.5-1, derive the state-variable model using the algorithm described in 

Section 10.4. 

Consider a variant of the matrix A used in Example 10-2. In this example, we used A(2,1) = —0.6. 

(a) Changing this to A(2,1) = —0.9, and assuming exact same values for B and C as in the example, what 
changes in the impulse response do you observe and why? 

(b) In Example 10-2, we used 50 data samples to estimate the system matrices such that the esti- 
mated impulse response matches the measured output perfectly. Repeat the identification with 
A(2,1) = —0.9, and check if we should use lesser or more number of samples to achieve the same 
accuracy in matching. 

Derive the SISO black-box identification algorithm described in Section 10.4 when the excitation input 

u(k) is a unit step signal. 

Consider the SISO continuous-time model: 


x(k + 1) = Ax(k) + Bu(k) 
y(k) = Cx(k) 


where 


o 1 0 
TE 4 s= [?] C=[0 1] 


Assume u(k) to be an impulse input. Sample this system with T = 10s, 1 s, and 0.1 s, and compare 
how accurately the estimated impulse responses, computed using the black-box identification method of 
Section 10.4, for each case match the measured response y(k), where k = 0, 1,2, ++- , 50. 

Consider the following three data sets, which are the same data set given in Example 10.2 but corrupted 
with varying levels of white Gaussian noise. Three different SNRs are used to generate the noisy output, 
namely 1 dB, 10 dB, and 50 dB. It can be seen that as the SNR is increased the output values approach 
those given in the example. Assuming the input to be a unit impulse, repeat the identification for each of 
the three noisy cases, and compute how the poles of the identified transfer function differ from the actual 
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poles. Also, plot the percentage error in the estimated poles versus the actual poles against the increasing 
levels of SNR. 


1. SNR = 1dB 


k 0 1 2 3 4 5 6 7 8 


yk) 0.979 0.7483 0.3272 —1.8435  —0.2816 —0.7421 —1.4067 0.4538 0.2511 


2. SNR = 10dB 


K 0 1 2 3 4 5 6 7 8 


y(k) 0.0106 0.5743 0.0585 0.0959 —0.0608 —0.0009 —0.084 —0.5524 —0.0905 


3. SNR = 50 dB 


k 0 1 2 3 4 5 6 7 8 


yk)  —0.0026 0.9929 —0.3017 -—0.0165 0.0275 —0.0051 0.0005 0.001 —0.0003 


10.5-1. 


10.5-2. 


10.5-3. 
10.5-4. 


10.6-1. 


10.6-2. 


(a) A first-order system yields the following input-output measurements: 


= 


Input Output 


0 10 0 
1 10 12.2 
2 10 20.1 


Find the system transfer function by the least-squares batch procedure, using all the data. 

(b) An additional data pair for k = 3 is measured, with the input equal to zero and the output equal to 
31.8. Start the recursive least-squares procedure using the results of part (a), and calculate 6 using the 
additional data pair. 

For a third-order discrete system, suppose that the data pairs [u(k), y(k)], k = 0, 1,--- 5, are available. 

In these data, u(k) is the input and y(k) is the output. Write the complete expression for F7(N)y(N) as in 

(10-43), using all the data. 

Derive (10-47), the weighted least-squares estimate. 

Derive the transfer function for the LTI model in Examples 10-3 and 10-4 using weighted least squares. 

Manipulate the weights and test whether the transfer function can be identified with lesser number of 

measurements used in the examples. You may use a maximum tolerance of 107° for the estimation error 

between the identified transfer function coefficients and their actual values. 

Consider that b;, b2, *** , bm in (10-30) for some given positive integer m are all known constants. Using 

the method proposed in Section 10.6 re-derive (10.43) to compute the least-squares estimate of only the 

unknown coefficients of (10-30). 

Consider the data set given in Example 10.2. Assume that the system has three poles and two zeros. One 

of the poles is at z = 0.1 and one of the zeros is at z = 0.10002. Identify the system transfer function. 

Compare the estimated values of the two remaining poles with those given in Example 10.2. 

Consider the following unit step response of a discrete-time LTI system: 


k 0 1 2 3 4 5 6 7 8 


y(k) 0 4 -8 16 —24 36 —48 64 —80 


10.7-1. 


10.7-2. 


10.7-3. 


10.8-1. 


10.8-2. 
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It is known that the transfer function of the system has three poles and two zeros. All three poles are at 
z = 1. Assuming the sampling time T = 0.1 s, derive a least-squares estimate of the transfer function 
using this prior information. 

Using (10-47), (10-52), (10-56), and (10-57), derive the equations for the recursive least-squares estima- 
tion, (10-59)-(10-61). 

Use recursive least squares to estimate the transfer function for the LTI model given in Example 10-2 using 
the impulse response data y(k). Verify that the poles of this transfer function match the eigenvalues of the 
system matrix identified in Example 10.2. 

Using the MATLAB function awgn, repeat the recursive least-squares estimation of Example 10.4 when 
the output is corrupted by a white Gaussian noise with 10.0 dB SNR. Compare the estimation results with 
those for 1.0 dB SNR. 

Consider the values of y(k) in Problem 10.6-3 at k = 0, 2, 4, 6, and 8. Using these values and assum- 
ing T = 0.2 s, repeat the least-squares estimation of the transfer function. Next, consider the values at 
k = 0,4, and 8, and assuming T = 0.4 s repeat the estimation one more time. Compare both of these 
estimates with that obtained in Problem 10.6-3. 

Consider the transfer function 


Z 


E e TE ee, 
O= 24032401 


Excite this transfer function with the following inputs, and collect the respective outputs in a vector y(k), 
k = 0,1,...,20. Assume the sampling time T = 0.1 s. 

(a) u(k) = sin (10k) 

(b) u(k) = 100 sin (10k) 

(c) u(k) = sin (10k) + sin (20k) 

(d) u(k) = sin(k) + sin (10k) + sin (100k) 

(e) u(k) is a unit square wave stretching from k = 0 tok = 2 

(£) u(k) is a unit square wave stretching from k = 0 tok = 10 

(g) u(k) is a unit step 

Using y(k) and u(k) for k = 0, 1,..., 20, derive the transfer function of the system using least-squares 
method. Compare each solution to the actual transfer function G(z). 
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Linear Quadratic 
Optimal Control 


11.1 INTRODUCTION 


In Chapter 8 we presented design techniques, such as Bode plots and Nyquist plots, that are 
termed classical, or traditional. The two techniques developed are the frequency-response tech- 
niques and the root-locus technique. Both methods are very effective, but are largely trial and 
error, with experience being very useful. Even when an acceptable design is completed, the 
question remains as to whether a “better” design could be found. The pole-assignment design 
technique of Chapter 9 is termed a modern technique, and is based on the state-variable model of 
the plant, rather than on the transfer function as required by the classical methods. In this proce- 
dure we assumed that we know the exact locations required for the closed-loop transfer-function 
poles, and we can realize these locations, at least in the linear model. Of course, for the physical 
system, the regions in which the pole locations can be placed are limited. 

In the pole-assignment technique, we assume that we know the pole locations that yield the 
“best” control system. In this chapter we develop a different technique that yields the “best” control 
system. This technique is an optimal design procedure, and assumes that we can write a mathemati- 
cal function which is called the cost function. The optimal design procedure minimizes this cost 
function, hence the term optimal. However, in most cases the choice of the cost function involves 
some trial and error; that is, we are not sure of the exact form that the cost function should take. 

For discrete systems, the cost function (also called the performance index) is generally the 
form 


N 
Jy = a LYW. r(k),u(k)] (11-1) 


In this relationship k is the sample instant and N is the terminal sample instant. The control sys- 
tem outputs are y(k), the reference inputs are r(k), and u(k) are the control inputs to the plant. 

For a physical system, the control inputs are always constrained. For example, the ampli- 
tude of each component of the control vector may be limited, such that 


|u<k)| = U; 


11.2 The Quadratic Cost Function 


where each U; is a given constant, and the subscript i denotes the i” input. For the case of limited 
control energy, we have 


u;(k) <= M; 


where each M; is a given constant. The availability of finite control energy may be represented 
by a term in the cost function (11-1) as 


N 
du OR}Huck) 
k=0 


where R(k) is a weighting matrix and is not related to r(k). This function is called a quadratic 
form, and will be considered in detail in the following sections. In any case, the control must sat- 
isfy certain constraints; any control that satisfies these constraints is called an admissible control. 

In this chapter, the design technique for optimal linear regulator control systems with qua- 
dratic cost functions is developed. This design results in a control law of the form 


u(k) = —K(k)x(k) (11-2) 


Hence we have linear, time-varying, full-state feedback. The same limitations of full-state feed- 
back apply here as in Chapter 9. It will generally be necessary to utilize an observer to imple- 
ment the control law. The observer may be designed by the techniques presented in Chapter 9. 

This chapter requires a background in the mathematics of matrices. Appendix IV presents 
a brief review of the required matrix mathematical definitions and manipulations. 


11.2 THE QUADRATIC COST FUNCTION 


We begin the development of optimal control design by considering the case of a quadratic cost 
function of the states and the control signals, that is, 


N 
Jy = XOU) + uORWuh) (11-3) 
k=0 


where N is finite and Q(k) and R(k) are symmetric. The linear plant is described by 
x(k + 1) = A(A)x(k) + B(bu(k) 
y(k) = C(k)x(k) 


(11-4) 


Note that both the plant and the cost-function matrices are allowed to be time varying. Recall that 
the design procedures developed earlier require linear time-invariant plants. 

The quadratic cost function is considered because the development is simple and the cost 
function is logical. For example, consider a second-order single-output system with 


y(k) = Cx(k) = [a x(k) 


Suppose that we want to drive the output to zero, and hence we will choose the cost function to 
contain yk). Then 


yh) = y OYK = xO) = xO) 


419 


420 


Chapter 11 ° Linear Quadratic Optimal Control 


where Q = C'C is square. Hence we see for this case that the quadratic function appears 
naturally. 
Consider the quadratic function 


F = x'Qx = [x vf aa 


q2 qril% 


= 2 2 
= qiXi + (q2 + Ga)Xi%2 + qo0X9 


(11-5) 


Note first that F is a scalar and that there is no loss of generality in assuming Q to be symmetric. 
Now, if the quadratic form in (11-5) is positive semidefinite [1], which we will require, then 


F = 0, x#0 
F= 0, x=0 


Then, in general, minimizing F will minimize the magnitude of states that contribute to F, in 
some sense. For example, if 


1 0 
F= =o |x 


then minimizing F will tend to minimize the magnitudes of x, and x). However, if 


100 d 
X 


F = 1004 + = x| E 


then minimizing F will also minimize |x; | and |x|, but |x; | should be much smaller than |x, |. 


As a third case, suppose that 


(i.e., F is not a function of x). Then in minimizing F only x, is minimized, and x, is determined 
by its relationship to x4. 
Consider now the contribution of the control input u(k). Suppose that 


wRu = [u ea falta 


hni mnll 


G 


1 l (11-6) 
= ruut + (r2 + mhi)uji + hh 


Note again that there is no loss in generality in assuming the matrix in a quadratic form is sym- 
metric. If G in (11-6) is positive definite [1], which we will require, then 

G > 0, u #0 

G = 0, u=0 


Thus if we minimize G, we are minimizing the control functions. If G were allowed to be only posi- 
tive semidefinite, some components of the control vector could be quite large when G is minimized. 


11.3 The Principle of Optimality 


A mathematical test for positive definiteness is as follows. A square matrix is positive 
definite if and only if all of its eigenvalues are real and positive. If the eigenvalues are real and 
positive, except for some that have a value of zero, the matrix is positive semidefinite [1]. 

Consider the total cost function of (11-3): 


N 
[eq. (11-3)] Jn = 2x WQEXH) + (HOROU) 


If Q(x) were positive semidefinite and R(k) were the null matrix, minimization of (11-3) would 
force the x(k) vector toward zero very quickly, which in general would require a large u(x). For 
a physical system, u(k) is always bounded, and in general the large u(k) would not be realizable. 
Hence the positive definite matrix R(x) is added to the cost function to limit u(x) to realizable 
values. Then, in using the cost function (11-3), we include the term involving x(k), so that, in 
some sense, the magnitudes of the states are driven toward zero. The term involving u(k) is 
included in order that the components of the control vector will be limited in magnitude such that 
the design is physically realizable. 


11.3 THE PRINCIPLE OF OPTIMALITY 


The optimal control design problem posed in Section 11.2 may be stated as follows: 
For a linear discrete plant described by 


[eq. (11-4)] x(k + 1) = A(A)x(k) + B(k)u(k) 
y(k) = C(k)x(k) 


determine the control (11-7) 
u°(k) = f [x(k] (11-7) 


that minimizes the quadratic cost function 


N 
[eq. (11-3)] Jy = 2 HQHx(H + WORKU) 


where N is finite, Q(k) is positive semidefinite, and R(A) is positive definite. In (11-7), the super- 
script o denotes that the control is optimal. 

The solution (11-7) can be obtained by several different approaches. The approach to be 
used here will be through the principle of optimality, developed by Richard Bellman [2, 3]. For 
our purposes, the principle may be stated as follows: 


If a closed-loop control u°(k) = f[x(k)] is optimal over the interval 0 = k S N, it is also 
optimal over any subinterval m = k = N, where 0 = m = N. 


The principle of optimality can be applied as follows: Define the scalar F, as 


F, = XOQ) + ORO uk (11-8) 
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Then (11-3) can be expressed as 

Jy = Fo t+ Fi + +++ + Fy- + Fy 
Now, let S,,, be the cost from k = m to k = N; that is, 


Sin = In — Inem = Fry m+1 t Fyemt2 t tt + Fy- + Fy (11-9) 


These cost terms are illustrated in Fig. 11-1. 

Note that k can vary from 0 to N, while m can vary from 1 to (N + 1). The principle of 
optimality states that if Jy is the optimal cost, then so is S,,, for m = 1,2,...,(N + 1). We can 
apply the principle of optimality by first minimizing Sı = Fy, then choosing Fy_, to minimize 


S> = Fy-1 + Fy = S3 F Fy-1 
then choosing Fy» to minimize 
S3 a Fy-2 + Fy-1 + Fy = SS + Fy-2 
and so on, until S+; = Jy is minimized. Design using this procedure is also known as dynamic 
programming. 
A simple example will now be given to illustrate optimal control design using the principal 


of optimality. Then the general design procedure will be developed in Section 11.4. Consider the 
first-order plant described by 


x(k + 1) = 2x(k) + u(k) (11-10) 


Note that this plant is unstable. We wish to determine the control law u(k) that minimizes 
2 2 
h= DCW + Hh) = Dh 
k=0 k=0 
Hence we wish to choose u(k) to minimize 


h= Fy + F, + F = x0) + WO) + x) + (1) + 2°72) + 2) (1-1) 


subject to the relationship, or constraint, (11-10). Note first that u(2) does not affect any of the 
other terms in (11-11); thus we must choose u(2) = 0. This requirement will also appear in the 
following development. 


Amplitude 


Fy Foe Fy-2 Fy-1 
F, i m a N | i 


0 1 2 N-m N-m+1 N-2 N-1 N 
FIGURE 11-1 Terms in the cost function. 


xy 


11.3 The Principle of Optimality 
First, from (11-9), 


Si = Jy- an = h- J = P = x2) + (2) 


By the principal of optimality, u(2) must minimize this function. Hence 


aS; 
au(2) 


= 2u(2) = 0 


since x(2) is independent of u(2). Thus u(2) = 0, and 
S? = x42) (11-12) 
Next, we calculate S}. 
S = S +F = S$ t+ x) + Wd) 
From (11-10) and (11-12), S may be expressed as 
Sy = [2x(1) + u)? + x71) + PA) 
By the principle of optimality, 


aS, 
au(1) 


= 2[2x(1) + u(1)] + 2u(1) = 0 


since x(1) is independent of u(1). Thus 


u(1) = —x(1) 


and 
S3 = 3x1) 
By the same procedure, 


S3 = Jh = S} + F = S$ + x70) + u0) 


Hence 
S3 = 3x°(1) + x0) + (0) 
= 3[2x(0) + u(0)]? + x40) + w(0) 
and 
ie 6[2x(0) + u(0)] + 2u(0) = 0 
au(0) 
Thus 


u(0) = —1.5x(0) 
Therefore, the optimal control sequence is given by 
u(0) = —1.5x(0) 
u(l) = —x(1) (11-13) 
u(2) = 0 
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The minimum-cost function is then 


S3 = J3 = 3[0.5x(0)]? + x7(0) + [-1.5x(0)]? 
= 4x°(0) 
Thus no choice of {u(0), u(1), u(2)} will yield a smaller value of J, than will that of (11-13). 


The following points should be made about the example above. First, while no assumption 
was made concerning the form of the control law, the optimal control law is linear and of the form 


u(k) = —K(k)x(k) 


Next, even though the plant is time invariant, the feedback gains required, K(k), are time varying. 
In the following section a general solution to this optimal control design problem will be derived, 
and the points above will be shown to also apply to the general case. 

Note also that the optimal control design is solved in reverse time. The optimal gain K(i) 
cannot be calculated until all the remaining K(/), i < j = N are known. 


11.4 LINEAR QUADRATIC OPTIMAL CONTROL 


We will now solve the linear quadratic (LQ) optimal design problem posed in Section 11.3, 
which is as follows: 
For a linear discrete plant described by 


[eq. (11-4)] x(k + 1) = A(A)x(k) + B(k)u(k) 
y(k) = C(k)x(k) 


determine the control 
[eq. (11-7)] u(k) = f[Ix(k)] 
that minimizes the quadratic cost function 
N 
[eq. (11-3)] Jy = DFDK) + AORO) 
k=0 
where N is finite, Q(A) is positive semidefinite, and R(k) is positive definite. 


First a short review of the differentiation of quadratic functions is in order (see 
Appendix IV). Given the quadratic function x’Qx, then 


0 

ag XQ] = 2Qx (11-14) 
Given the bilinear form x’Qy, then 

0 

ox LX Qy] = Qy (11-15) 
and 

ð T T, 

ae Qy] = Q'x (11-16) 
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In (11-14) we can assume that Q is symmetric. However, in (11-15) and (11-16), Q is not neces- 
sarily symmetric. Note also that since x’Qy is a scalar, 


x’Qy = Qy)" = y’Q’x 


In (11-9) we defined S, to be the cost from the (N — m) sample instant to the N (terminal) 
sample instant, that is, 


[eq. (11-9)] Sin = Jy — Jy-m 
Hence from Fig. 11-1 we see that S,,;, can be expressed as 
Sint = Sm + Fy-m 


From (11-8), we can then write 
Smt = Sm + XN — MQN — m)x(N — m) + W(N — m)R(N — m)u(N — m) (11-17) 


Thus, from the principle of optimality, 


Ont a (11-18) 
au(N — m) i 
if S,, in (11-17) is replaced with S9. 
Consider first $4: 
S, = Fy = x(N)Q(N)x(N) + u(N)R(N)u(N) (11-19) 
Since x(N) is independent of u(N), u°(V) = 0 and 
S? = x(N)'Q(N)x(N) (11-20) 


We see then that SẸ is quadratic in x(V). For S2, we get the expression, from (11-17), that 
Sa = S? + xN — 1)Q(N — 1)x(N — 1) + WW — DRAN — Lu - 1) (11-21) 
where, from (11-4) and (11-20), 


S? = [Ax(V — 1) + Bu(W — 1)]'Q(N)[AX(N — 1) + Bu(W — 1)] 


u’(V-1) (11-22) 


With (11-22) substituted into (11-21), we solve 


aS 


aw- D ° 


for u(N — 1), with the result of the form 


w(N — 1) = -K(N — Dx(N — 1) (11-23) 
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The derivation of this result is straightforward and is given as Problem 11.4-1.We will not at this 
time solve for K(N — 1). However, when (11-23) is substituted into (11-21), the result is seen to 
be quadratic in x(N — 1). Hence we can write 


S3 = xN — DPN — Dx(N — 1) (11-24) 


where P(N — 1) is symmetric. 
Following the development in the paragraph above in solving for S3, we see that $3 is also 
quadratic. Hence we may write 


S3 = xN — DPN — 2)x(N — 2) (11-25) 
Thus the general relationship of S?, is seen to be 
So. = xN- m + 1)P(N — m + 1I)x(N — m+ 1) (11-26) 
From (11-4), we can then express S¥, as 
S°, = [Ax(N — m) + Bu(N — m)]'P(N — m + DIAx(N — m) + Bu(W — m)] (11-27) 
Next we substitute (11-27) into (11-17) to get the expression for S,,+,. Then we differ- 
entiate S,,,; with respect to u(N — m), set this to zero, and solve for u°(N — m). The algebra 
becomes unwieldy, and to simplify this, we will drop the notational dependence of (N — m). 
Then, in the final solution, we will reinsert this dependence. From (11-27) and (11-17), 
Sm+1 = [Ax + Bu]/P(V — m + D[Ax + Bu] + x’7Qx + u’Ru (11-28) 
Then, from (11-14), (11-15), and (11-16), 


Sin 
aa = BĪP(N — m + [Ax + Bu] + B/P(W — m + DIAx + Bu] + 2Ru = 0 


or 
2B’P(N — m + 1)Ax + 2[B’P(N — m + 1)B + Rju = 0 
Thus the desired solution is 
u? = —[B’P(N — m + 1)B + RJ'B’P(N — m + 1)Ax (11-29) 
Hence, from (11-23) and (11-29), the optimal gain matrix is 
K(N — m) = [BN — m)P(N — m+ LBW — m) + RIV - my! 
x B'(N — m)P(N — m + 1)A(N — m) (11-30) 


and 


w(N — m) = —K(N — m)x(N — m) (11-31) 
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Next we develop the expression for Sh+1. In (11-28), from (11-31), 


Ax + Bu = [A — BK]x 
and 
S21 = {[A — BK]x} P(N — m + DIA — BK]x + x’Qx + [Kx]’RKx 
or 
S21 = x{[A — BK]P(N — m + D[A — BK] + Q + K’RK}x 


But, from (11-26), 
S24, = x'P(N — m)x 
Hence 
P(N — m) = [A(N — m) — BIN — m)K(N — m)]'P(N -m + 1) 
x [AWN — m) — BIN — m)K(N — m)] (11-32) 
+ QN — m) + KN — m)R(N — m)K(N — m) 


The final design equations will now be summarized. The design progresses backward in 
time from k = N. We know the final value of the P matrix from (11-20) and (11-26). 


P(N) = QW) (11-33) 


For a time-invariant system and cost function, from (11-30) we obtain the optimal gain-matrix 
expression 


K(N — m) = [B’P(W — m+ 1B + RJ 'BP(N — m + 1)A (11-34) 
Hence we can solve for K(N — 1), and from (11-32), 


P(N — m) = [A — BK(N — m)]’P(V — m + DIA — BK(N — m)] 
(11-35) 
+ Q + KIN — m)RK(N — m) 


This equation can be expressed in other forms (see Problem 11.4-2). One of the simpler forms is 
P(N — m) = A'P(N — m + 1)[A — BK(N - m)] + Q (11-36) 


Thus we may solve either (11-35) or (11-36) for P(N — 1). We see then that (11-34) and 
either (11-35) or (11-36) form a set of nonlinear difference equations which may be solved 
recursively for K(N — m) and P(N — m). Thus (11-33), (11-34), and (11-36) form the design 
equations. 

We can also express the design equations as a function of k. In (11-31), (11-34), and 
(11-36), let k = N — m. The design equations are, fork = 0, 1,2, ---,N — 1, 


uw(k) = —K(&)x(k) (11-37) 


K(k) = [B’P(k + 1)B + R] 'B’P(K + 1)A (11-38) 
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P(k) = A’P(k + DIA — BKD] + Q (11-39) 


with P(N) = Q and K(N) = 0. 
Note from (11-9) that Jy can be expressed as 


Jy = Sy + Jo = Sy + x"(0)Q(0)x(0) + u7(0)R(0)u(0) 


since Fy = Jo. But from Fig. 11-1, this expression is simply Sy+ ,. Thus from (11-26), the mini- 
mum cost is given by 


Ji = Sher = x7(0)P(0)x(0) (11-40) 


For the case that the system and/or the cost function are time varying, the following substi- 
tutions must be made in (11-38) and (11-39): 


A > A(k) 
B— Bik) 
Q> QA) 
R—R(k) (11-41) 


Two examples illustrating this design procedure will now be given. 
EXAMPLE 11.1 


We wish to design an optimal control law for the system 
x(k + 1) = 2x(k) + ulk) 


with the cost function 
2 
h = SHH + WH 
k=0 


Note that this is the same design problem considered in Section 11.3. Now, the required param- 
eters are 


From (11-33), 


PQ) = Q2)=Q=1 


From (11-38), the gain required is 
K(2 — 1) = K(1) = [B’P(2)B + RY 'B'P(2)A 


= [1 + 17-'a)d)2) = 1 
From (11-39), 


P(1) 


A'P(2){A — BK(1)} + Q 
= 2(1){2 - ()d)} + 1 = 3 
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Then, from (11-38), 
K(O) = [BTP(1)B + RJ'BTP(DA 
= [3 + 17 '()3)Q = 15 
and from (11-39), 
PO) = 23){2- 15} +1=4 
Hence the optimal gain schedule is 
{K(O), KC) } = {1.5, 1} 
and from (11-40), the minimum cost is 
J3 = x"(0)P(0)x(0) = 4x°(0) 


The results check those obtained in Section 11.3. 


EXAMPLE 11.2 


As a second example, we consider the servo system utilized in several examples of pole- 
assignment design in Chapter 9. 
The system is shown in Fig. 11-2, and has the state model (see Example 9.1) 


kis f ae fx N pe 


0 0.905 0.0952 
yk) = [1 O}x(k) 


lw 


where x;(f) is the shaft angle and x(t) is the shaft angular velocity. We choose the cost function 
to be 


2 
Jy = Sx(HQx(k) + Ru (k) 
k=0 


with 


1 0 
= ; R=1 
e-[5 o 
Thus velocity is ignored in the cost function. We are attempting to minimize the magnitude of 
the position x(k) without regard to the velocity x(k) required. The weight of the control, R, in 
the cost function is chosen arbitrarily. N is chosen equal to 2 so that the solution can be calcu- 
lated by hand. Thus, from (11-33), 


1 0 
pa) = 9 =|" j 


U(s) “Ts 1 Y(s) 


T=0.1s s 
FIGURE 11-2 Servomotor system. 
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In (11-38), for k = 1, 


1 0 || 0.00484 
B’P(2)B + R = [0.00484 0.0952)] | | 


0 0JL0.0952 


0.00484 
= [0.00484 | 


+1=1. 234 
0.0952 | meee 


Then, in (11-38), 


K(1) = [B’P(2)B + RY! B'P(2)A 


1.0000234 
[0.00484 0.000461] 


1 alte a 
o ojlo 0.905 


1 
= —,10.00484 0.0952 


To calculate P(1) from (11-39), we need 


0.00484 


Gea i 0952 


| [0.00484 0.000461] 


B ies x 10° 2.23 x | 
461x104 4.39 x 10° 


Then 


1.00 a 
—4.61 X 10™% 0.905 


[A — BK(1)] = | 
and 


1 0.0952 | 


T = = 
APOIA — BK(1)] Hees 0.00906 


Then, from (11-39), 
P(1) = A’P(2)[A — BK(1)] + Q 


i 0.0952 | 
0.0952 0.00906 


The calculations above are carried through in detail to illustrate the calculations required for one 
step of the solution of the difference equations (11-38) and (11-39) for a second-order system 
with a single input. Obviously, a computer solution is required. If these difference equations are 
solved again, the results are 


K(O) = [0.0187 0.00298] 


and 


3.0 0.276 | 


P(O) = | 
0.276 0.0419 
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A MATLAB program that performs the calculations of this example is given by 


format ShortEng 


A = [1 0.0952;0 0.905]; B = [0.00484; 0.0952]; 
Q = [1 O70: Ol] e°R = Te NS s23 Po S05 

disp(' k Gains') 

for n=1:N 


KK = inv(B'*P*B+R) *B'*P*A; 
P1 =A'*P* (A - B*KK)+Q; 


P=P1; 
k = N - n+l; 
[k, KK] 
end 
disp ('The final value of the P matrix is:'), P 


EXAMPLE 11.3 


Next a more practical design will be performed, using a computer solution; that is, (11-38) 
and (11-39) are solved recursively via the computer. We will compare the results with those of 
Example 9.1. In Example 9.1, the plant equations are (see Fig. 11-2) 


1 0.0952 0.00484 
x(k) + 


ip 
0 0.905 0.0952 lw 


+=] 


and the closed-loop characteristic equation zeros had a time constant of 1.0 s. We generally 
consider the response to have settled out in five time constants, or 5 s in this case. Hence we 
will choose N of the cost function of (11-3) to be 51 and compare responses for the first 5 s. The 
Q and R matrices of (11-3) are chosen to be the same as in Example 11.2, that is, 


gsi ph ea 


The optimal gains obtained for this design are plotted in Fig. 11-3. Also shown are the optimal 
gains for values of R of 0.1 and 0.03, with Q unchanged. As the value of R is reduced, the con- 
tribution of the control effort to the cost function is reduced. Hence the control effort will be 
increased in order to reduce the magnitudes of the states. This effect is seen in Fig. 11-3. 

Shown in Fig. 11-4 is the initial-condition response, for x(t), of this system for R = 1.0 
and R = 0.03, with 

ofi 
X — 
0 


The effects of the choice of R on the transient response of the closed-loop system can be seen 
from this figure. Also, by comparing Figs. 11-3 and 11-4, we see that the response has reached 
zero before the gains begin decreasing for the case that R = 0.03. This is not true for the case 
that R = 1.0. 

The initial-condition response for Example 9.1 is given in Fig. 9-2. It is seen that the opti- 
mal system response settles faster for R = 0.03, but slower for R = 1.0. 
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5.08 R=0.03 


La 
t(s) 
a 
0 1 2 3 4 5 t(s) 
FIGURE 11-3 Optimal gains for Example 11.3. 
x(t) 4 
1.0 
0.5 
0 — 
5 ts) 


=0:5:— 
FIGURE 11-4 Time response for Example 11.3. 
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11.5 THE MINIMUM PRINCIPLE 


In the developments above, Bellman’s principle was used in deriving the optimal control design 
equations (11-38) and (11-39). The equations may also be derived utilizing the minimum prin- 
ciple [4]. The minimum principle is presented in this section. This principle will prove to be use- 
ful when steady-state optimal control is considered in the following section. 

The optimal control problem posed in Section 11.2 may be stated as follows: 

For a linear discrete plant described by 

[eq. (11-4)] x(k + 1) = A(k)x(k) + B(k)u(k) 

y(k) = C(k)x(k) 


determines the control 
[eq. (11-7)] u°(k) = f[x(k)] 


that minimizes the quadratic cost function 


1 N 
[eq. (11-3)] Jy = 72% ORO + W (ORkulk) 


where N is finite, Q(A) is positive semidefinite, and R(A) is positive definite. In (11-7), the 
superscript o denotes that the control is optimal. Note that the factor } added to (11-3) will not 
change the results, but will simplify the following derivations somewhat. 

The minimum principle may be utilized to solve the optimal control problem. 


MINIMUM PRINCIPLE [4]. If the input u°(k) and the corresponding trajectory x°(k) are opti- 


mal, there exists a nontrivial vector sequence {p°(k)}} such that u°(k) is the value of u(k) that 
minimizes the Hamiltonian 


H = TOO + WORO] + [Pk + DTA K + BOUK] (11-42) 


and the “costate vector” p°(k) satisfies 


o mek ðH oO = O n 
p(k) = KE P(N) = QNX’ (N) (11-43) 
fork s N. 
From (11-43) we obtain 
p(k) = QXK) + AOp k + 1) (11-44) 
and dH /du(k) = 0 yields 
u’(k) = -R !(k)B"(k)p°(k + 1) (11-45) 


Hence this approach leads to the state equations (11-4), 


[eq. (11-4)] x(k + 1) = A(A)x(k) + B(k)u(k) 
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and the costate equations (11-44), with the optimal control given by (11-45). The state equations 
will have an initial condition x(k,), and are solved forward in time. The costate equations have 
the final state (11-43), and are solved backward in time. However, since the state and costate 
equations are coupled, these equations constitute a linear two-point boundary value problem. It 
is beyond the scope of this book to discuss the solution of two-point boundary value problems. 
However, it can be shown that the solution of (11-4), (11-44), and (11-45) yields the same opti- 
mal gain matrix as does the solution of (11-38) and (11-39). 


11.6 STEADY-STATE OPTIMAL CONTROL 


If we consider the design results of Example 11.3, given in Fig. 11-3, we see that the optimal 
gains approach constant values with decreasing time. In general, this is true for time-invariant 
systems and cost functions. 

Note also that if we increase N in Example 11.3, the optimal gains for the final 51 sample 
instants are the same as those calculated in this example. The values of the gains at earlier sam- 
pling instants will simply be those constant values indicated in Fig. 11-3. Hence if we allow N 
to approach infinity, or if we allow the initial time to approach —*, we obtain a steady-state 
solution in which the optimal gains are constant values. We consider this steady-state solution in 
this section. 

First we consider the difference equations (11-38) and (11-39) employed in the design of 
optimal control systems. 


[eq. (11-38)] K(k) = [B’P(k + 1)B + RY 'BP(k + 1)A 
[eq. (11-39)] P(k) = AP(k + DIA — BKW] + Q 


In this section A, B, Q, and R are assumed to be constant. If (11-38) is substituted into (11-39), 
the result is a difference equation for the matrix P. 


P(k) = AP(k + 1) {A — B[B'P(k + DB + RY! x B'P(k + 1)A} + Q (11-46) 
This equation is often written in a slightly different form, 
P(K) = AP(K + DA + Q — AP(k + 1) xX BIB’P(K + DB + RJ 'B’P(K + DA (11-47) 


and is referred to as the discrete Riccati equation. The inverse in (11-47) always exists since R 
is positive definite and P(k + 1) is at least positive semidefinite [the cost function in (11-3) and 
(11-26) cannot be negative]. 

Before deriving the steady-state solution to (11-47), we will derive a non-recursive solution 
for P(k) in the discrete Riccati equation for time-invariant systems. This solution will then yield 
the steady-state solution. We can express the state and costate equations of (11-4) and (11-44) as 


pd _ als + | (11-48) 
p(k) pk + 1) 
where 
A! A'R. 
= he AT + o ere 
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and 
Rc = BR |B’ (11-50) 
Note that H is 2n X 2n. For a matrix 
D E 
H = p A (11-51) 


where the partitions D, E, F, and G are n X n, then 


_, _[D' + D'E[G - FD'E]'FD'! -— D'E[G - FD'E]' 
H = -IẸ]-IFD-! -Ip]-! (11-52) 
—[G — FD EJ FD [G — FD E] 
(see Appendix IV). Hence, from (11-49), (11-51), and (11-52), 
A+R-A‘Q -R d 
H! = a ; 11-53 
| -A'Q AT ( ) 
where 
AT = (A = (Ay! (11-54) 
If we denote h as an eigenvector of H, and A as an eigenvalue, then 
Hh = Ah (11-55) 
Let 
f 
h = (11-56) 
g 


where f and g are n-vectors. Substituting (11-49) into (11-55) yields two equations. Also, substi- 
tuting (11-53) into 


-r| 8| _ g 
H E = | E| (11-57) 


yields the same two equations. Thus A is an eigenvalue of H~! and hence H “ and therefore 1/A 
is an eigenvalue of H. Thus the eigenvalues of H are such that the reciprocal of every eigenvalue 
is also an eigenvalue. 

Next we define the vectors v(k) and s(k) and the similarity transformation W (see 
Section 2.10) such that 


| a E 
= W 11-58 
p s(k) i i 


Then, for the case of distinct eigenvalues of H, from (11-48) we write 


v(k)| _|A 0 VRAD), w be + D : 
P ie e ps + | WwW HW s(k + 1) (11-59) 
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where A is a diagonal matrix of the eigenvalues of H that occur outside the unit circle. Then, in 
(11-58), the columns of W are the eigenvectors of H, and W is the modal matrix, as shown in 
Section 2.10. 

Next, let the matrix W be partitioned into four n X n matrices. 


Wi | (11-60) 


w-| 
Wi Wy 

Since, from (11-43), 
pV) = Qx°(N) 


from (11-58) and (11-60), 
p°(N) = [Wa v(N) + Wys(V)] = Qx°(V) = QIW vy) + Wys(V)] (41-61) 
We solve this equation for s(N). 
s(N) = —[Wy. — QW] W — QW, Jv) = Tv(N) (11-62) 


which defines the matrix T. Also, for (11-59), we can express v(N) and s(N) as, with j as a posi- 
tive integer, 


v(N) = A(N — j) (11-63) 
s(N) = A/s(N — j) (11-64) 
Thus, from (11-62) and (11-64), 
s(N — j) = AFS) = ATAWA — j) = GOWN - j) (11-65) 
which defines the matrix G(j). 
From (11-58) and (11-60), 
x°(N — j) = WaN — j) + Wps(N — j) (11-66) 
PN — j) = WaN — j) + Wys(W — j) (11-67) 


Eliminating v(V — j) and s(N — j) for (11-65), (11-66), and (11-67) yields 
PN — j) = [Wai + WGW + WGI XN — j) 
= MXN — j) (11-68) 
which defines the matrix M(j). This equation is a nonrecursive solution to the state and costate 
equations (11-4) and (11-44). 
To find the optimal gain, K(k), of (11-36), we let N — j = k + 1 in (11-68). 


pk + 1) = M(N — k — Dx%k + 1) = M(N — k — DfAx%(k) + Bu™(k)] (11-69) 


11.6 Steady-State Optimal Control 
Since the optimal control from (11-45) is 
u(k) = —R'B pk + 1) (11-70) 
solving these two equations for u°(k) yields 
u(k) = —[R + B’M(N — k — 1)B]'B’M(N — k — 1)Ax°(k) 
Comparing this equation with (11-37) and (11-38), we see that 
M(N — k — 1) = P(K + 1) (11-71) 
Then, from (11-65) and (11-68), 
M(k + 1) = [Wy + WGN — k — DIW; + WoGW-k- Dy! (11-72) 
where 
GIN = k= 1) = -A Woy = QW Wa — QW JAY (11-73) 
The optimal gain is given by, from (11-70), 
K(k) = [R + BMN — k — 1)BY'B/M(N — k — 1)A (11-74) 
and the nonrecursive solution of LQ design is (11-72) and (11-74). 
For the steady-state solution such that the gains in (11-38) have become constant values, it 
must then be true in (11-47) that 
P(k) = P(k + 1) = constant matrix (11-75) 
We will denote this constant matrix as P. Then (11-47) becomes 
P = APA + Q — A'PB[B’PB + R]'B’PA (11-76) 
This equation is referred to as the algebraic Riccati equation. Perhaps the simplest approach to 
finding the solution of this equation is that indicated in Example 11.3—set N to a large value and 
calculate the values of the P matrix (by computer) until the matrix elements become constant 
values. Then we have the solution to (11-76). 
We may also find the solution to the algebraic Riccati equation from the foregoing nonre- 
cursive solution to the discrete Riccati equation. In (11-68), 
PN — j) = MOLN — j) (11-77) 
The steady-state solution is obtained by allowing j to approach œ. From (11-65) and (11-68) 


jim MU) = Ws Wii! (11-78) 
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since A contains the eigenvalues outside the unit circle, and thus 


EATS 
Hence, from (11-71), the solution to the algebraic Riccati equation (11-76) is 
Ê = Wa Wii = lim MỌ) (11-79) 
and, for (11-74), 


K = [R + BPB’] 'B’PA (11-80) 


EXAMPLE 11.4 


The nonrecursive method of solution of the optimal control problem will be illustrated using the 
first-order system of Example 11.1. We wish to design an optimal control law for the system 


x(k + 1) = 2x(k) + ulk) 


with the cost function 
N 
Jy = SK) + WK) 
k=0 


Thus the required parameters are 


and 
Re =BR BR = 1 
Then in (11-49), 


= At A'Re |=- pa a 


T Loa! A + ocr} Los 25 
The eigenvalues of H satisfy the equation 


|AI — H| = (à — 0.5) — 2.5) — 0.25 = X -3A+1=0 


Thus the eigenvalues are 2.618 and 0.382. The eigenvectors satisfy the equation 
Hh = àh 


Thus the eigenvectors are 
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and the similarity transformation W is 


1 1 W, W 
W = [h, in) =| jel a d 
4.237 —0.236 Wi Wap 


Then, from (11-59), 


A 0 2.618 0 
= W'HW = 
| a i ae 


From (11-62), 
T = —[Wy — OW] [W — QW] = 2.619 
and from (11-65), 
GG) = ATA” = 2.619(0.382)7 
From (11-71) and (11-72), 


_ 4.237 — 0.618(0.382) 0) 
1 + 2.619(0.382 07D 


Pik +1) = MW -k- 1) 


and the optimal gain, from (11-74), is 


2M(N — k — 1) 
K(k) = 
1+ MN-k-— 1) 
For N = 2 andk = 1, 
Kil) = 2M(0) z 2(1) _ 
1 + M(O) 1+ 1 
and for k = 0, 
K(0) = 2M1) 283) 15 


1+ Md) 1+3 
These values check those of Example 11.1. The steady-state value, P, is obtained from (11-79). 
P = W Wt = 4.237 
and the steady-state gain is 
2(4.237) 


K = ——— = 1.618 
1 + 4.237 


Some general results regarding the steady-state solution of the discrete Riccati equation, (11-47), 
will now be given. Note that the steady-solution of this equation is the solution with N finite and 
m— ®, 


First we define the term stabilizable. 


DEFINITION The discrete-time system (11-4) is said to be stabilizable if there exists a matrix K 
such that the eigenvalues of A-BK are all inside the unit circle. 
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Then we may state the following theorem. 


THEOREM 1 [Ifthe system (11-4) is either controllable or stabilizable, the discrete Riccati equa- 
tion (11-47) has a limiting solution as m — œ; that is, 


lim P(N — m) = P 


mo 


as k —> —, This theorem is given without proof, as is the following theorem [4]. 


THEOREM 2 If the system (11-4) is observable, then P is positive definite and the optimal 
closed-loop system is asymptotically stable. 


11.7 OPTIMAL STATE ESTIMATION—KALMAN FILTERS 


In this section we extend the state-estimation concepts introduced in Chapter 9. We consider 
an optimal state estimation technique called Kalman filtering [5, 6]. The Kalman filter pre- 
sented in this section has the equations of the current observer of Section 9.5; the only differ- 
ence is that the gain matrix G is calculated by a different procedure. There is also a Kalman 
filter in the form of the prediction observer [7]; we will not consider that form. In the follow- 
ing, the reader is assumed to have some understanding of random variables and stochastic 
processes [5, 6, 8]. 
The plant is assumed to be described by the equations 


x(k + 1) = Ax(k) + Bu(k) + B, wk) 
y(k) = Cx(k) + v(k) (11-81) 
where x(k)[n X 1] are the states, u(k)[r X 1] are the known inputs, w(k)[s X 1] are the random 
plant disturbances, y(k)[p X 1] are the measurements, and v(k)[p X 1] are the random inaccura- 


cies in the measurements. The random inputs w(k) and v(x) in (11-81) are assumed to be uncor- 
related and to have Gaussian distributions with the properties: 


Elw] = 0, — E[v(k)] = 0 
cov[w(/),w(k)] = ElwU)w'(K)] = R, 8x (11-82) 
cov[v(j),v(k)] = EVOK] = R,òx 


E [-] is the mathematical expectation operation, and cov[-] denotes the covariance. In (11-82), Six 
is the Kronecker delta function, defined by 


0, JA 
ath 5a 
l1, j=k 
Hence w(k) and v(k) are discrete white-noise sequences with Gaussian distributions. 
We will not derive the equations for the Kalman filter; the derivation requires an extensive 
background in stochastic processes, which is beyond the scope of this book. However, the back- 


ground acquired in study of observers in Chapter 9 will help to understand the purpose and the 
properties of the Kalman filter. The mathematical expectation in (11-82) can be considered to be 
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an averaging operation. Hence the expected value of a vector or a matrix can be viewed as the 
vector or matrix made up of the average values of the elements. 
The estimates of the states x(k) are denoted as q(k), and the errors of estimation are 


e(k) = x(k) — qk) (11-83) 
The covariance of the error vector is denoted as P(k)[n X n], with 

P(k) = Efe(ke"(k)] (11-84) 
Hence the diagonal elements of P(k) are the average squared errors of the estimation. The cost 


function for the minimization process is chosen as the trace of P(k) (the sum of the diagonal ele- 
ments or the sum of the average squared errors of estimation). 


J(k) = trP(k) = Elei(k)] + Elik] + +++ + Elez(k)] 


(11-85) 


Talk) + k) + ++ + lk) 
where o2(k) is the variance of ek). This cost function can also be expressed as 
J(k) = Ele"(ke(k)] 


Note the expected values of the squared estimation errors are minimized, and not of the actual 
errors themselves. Since the system (11-81) has random inputs and the measurements have ran- 
dom errors, the actual estimation errors can never be determined. Hence we are forced to con- 
sider only the statistical characteristics of the estimation errors, and minimize a function of the 
expected values (average values) of these errors. Hence the Kalman filter is optimal only on the 
average. 

An additional property of the Kalman filter is that the cost function 


Ji(k) = tr Ele(Qe"(k)] (11-86) 


is also minimized, for Q any positive semidefinite matrix [5]. Hence, for example, for a sec- 
ond-order system, the cost functions 


Jik) = Elek] 
Jn'(k) = Elet(k)] + Elek] 
J3'(k) = 10E[e7(k)] + Ele3(k)] 


are all minimized. In addition, the sum 
N N 
Jy = > Elet(k+ Elex(k)] = > Eleke] 
k=0 k=0 


is minimized, since the individual terms are minimized. Hence we see that the Kalman filter is 
optimal in many different ways. 

As stated above, the mathematical development required to minimize (11-85) [or (11-86)] 
will not be given here; however, the resulting Kalman filter equations are [5, 6] 
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qk) = qk) + G@y(k) — CW] 
q(k + 1) = Aq(k) + Bu(k) 


(11-87) 


In these equations, q(x) is the predicted state estimate at the sampling instant k, and q(k) is the 
actual state estimate at k. The gain matrix G(x) is the Kalman gain, and is calculated from the 
covariance equations 


Gk) = MOCICM(OC" + R,T! 
P(k) = M(k) — G(A)CM(&) (11-88) 
M(k + 1) = AP(K)A’ + BR, BT 


In these equations, M(k) is the covariance of the prediction errors: 
Mik) = Ef{[x(k) — qlk) — gH} (11-89) 


P(k) is defined in (11-84). The second equation in (11-88) can be substituted into the third equa- 
tion in (11-88), and the result can be expressed as a single difference equation in M(k). 


M(k + 1) = A[I — G(Q)CIM(Q)AY + B,R,,B? (11-90) 


The Kalman gains G(k) can be precalculated, since they are independent of the measure- 
ments. Of course, the gains may also be calculated in real time. In either case, it is necessary 
to estimate both q(0), the initial predicted state, and M(0), the covariance of the errors in q(0). 
Once M(0) is estimated, the Kalman gains G(x) can be calculated from (11-88), using R, and 
R,, from (11-82). The Kalman filter equations (11-87) can then be solved in real time, using the 
gains G(A), the initial estimate q(0), and the measurements y(k). 

In the filter equations (11-87), the predicted estimate q(k) can be eliminated, resulting in 
the filter equation 


q(k) = [A — G(A)CA]q(k — 1) + [B — G(WCB]u(k — 1) + G(y(k) (41-91) 


For the steady-state Kalman filter, G(k) becomes constant. For this case, the filter equations of 
(11-87) [or (11-91)] have the characteristic equation 


Iz — (A — GCA)| =0 (11-92) 


If the gain G is determined by some procedure other than (11-88), the filter is called the current 
estimator, as discussed in Section 9.6. 

Suppose that the control system is designed by the linear-quadratic optimal procedure 
of the first part of this chapter, and the steady-state gains K are used. Suppose that, in addi- 
tion, the steady-state Kalman filter is employed to estimate the states. This design is called the 
infinite-horizon linear-quadratic-Gaussian (IH-LQG) design. The implementation is identical 
to that for the pole-placement current observer design of Chapter 9. Hence the control-estimator 
transfer function, D,,(z), is given by (see Fig. 9-8) 


[eq. (9-73)] D(z) = zK[al — A + GCA + BK — GCBK]'G 
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Implementation of full-state feedback control systems using Kalman filters as state estima- 
tors can also result in systems that are not robust, as discussed in Section 9.5 [9-11]. Hence the 
stability margins at the plant input must be checked, to ensure adequate relative stability. 


EXAMPLE 11.5 


The plant of Example 11.2, a servomotor, will be used to illustrate a Kalman filter design. This 
plant was also used in several examples for pole-placement and observer design in Chapter 9. 
The plant equations are 


1 0.0952 00484 
+=] 0.095 k B 


0 0.905 0.0952 
yk) = [1 O]xk) + vk) 


lw F | p% 


Recall that the two plant states are motor shaft position and shaft velocity. We will assume 
that the units of the states are degrees of rotation and degrees/second, respectively. The plant dis- 
turbance, w(k), affects both states equally. We will assume that the input covariances in (11-82) are 


Elw wk] = Ryde R, = 1 = 0$, 
EIK] = RO, R= 1 = oF 


where ø denotes the standard deviation. For a Gaussian-distributed random variable a with zero 
mean and variance of a” [6], 


prob[|a| = o] = 0.683 
prob[|a| = 20] = 0.955 
prob[|a| < 30] = 0.997 


For example, for the measurement inaccuracies, we are saying that 68 percent of the mea- 
surements are accurate to within 1° of shaft rotation, and in only 3 of 1000 measurements will 
the error be greater than 3°, on the average. Hence the probability of a Gaussian random variable 
with a value within the three-sigma (30°) value of its mean is almost a certainty. Also, the same 
numbers apply to the plant disturbance. 

Because of the complexity of the equations, the Kalman gains for this example were calcu- 
lated by computer, and the results are plotted in Fig. 11-5. 

The initial value of the covariance matrix, M(0), was assumed to be the identity matrix. The 
gains attain the steady-state values in approximately 15 iterations, or in 1.5 s. The steady-state 


gains are 
0.636 
G = 
| a] 
and the Kalman filter equations in (11-87) are completely specified. These equations can now 


be solved, once the initial estimate of the states, q(0), is made. The steady-state error covariance 
matrix is calculated to be 


| 0.636 |) 
0.570 0.599 
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K(k) 


Gain 


= 
0 4 8 12 16 k 
FIGURE 11-5 Kalman gain versus sample period. 


Hence for the steady-state Kalman filter, the standard deviation in the estimation of 
x(k) is oa = (0.636)!/? = 0.797° and o, = 0.771° s™!. For the estimate of the motor shaft 
position, the error is almost certain to be within the three-sigma value of approximately 2.4°. 
For example, if the measurement is 7°, the true position of the motor shaft is almost certain to 
be between 4.6° and 9.4°. If this error is too large, either more accurate instrumentation must be 
used, or the disturbances on the plant must be reduced. Recall that the filter itself is “best” for the 
error criteria used. A MATLAB program that calculates the Kalman gains is given by 


format ShortEng 


A = [1 0.0952;0 0.905]; Bl = [1;1]; C = [1 0]; 
Rw = 1; Rv = 1; M = [1 0;0 1]; N = 15; 

disp('k Gains') 

for k=1:N 


G = M*¥C'*inv(C*M*C'+Rv) ; 

P = M - G*C*M; 

M = A*P*A'+B1*Rw*B1'; 

[k,G'] 

end 

disp('The final value of the P matrix is:') 
P 


EXAMPLE 11.6 


The design of Example 11.5 will be extended to a steady-state Kalman filter and an infinite- 
horizon linear-quadratic-Gaussian (IH-LQG) control system design. For the IH-LQG design, the 
optimal control design of Example 11.3 is used, where 


o=|) bh a= 


The steady-state gains from this example are 


K = [0.964 0.719] 
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Hence the IH-LQG controller can be represented by the transfer function (9-73), and evaluation 
of this transfer function yields 


1.023z* — 0.9124z 
z — 1.147z + 0.3061 


Dek) = 


The plant transfer function is G(z), and the system open-loop function, for the system opened at 
the plant input, is 


1.023z? — 0.9124z /0.00484z + 0.004683 
D.&2)G(2) = z z ( £ ) 


z? — 1.147z + 0.3061 \ z? — 1.905z + 0.905 


(See Fig. 9-8). Calculation of the frequency response of this function yields a phase margin 
of 66.7° and a gain margin of 18.4 dB. Hence the system has adequate stability margins. It is 
always necessary to check stability margins, since nothing in the design assures adequate margins. 
A MATLAB program for this example follows. 


A [1 0.0952;0 0.905]; B = [0.00484; 0.0952]; C = [1 0]; 
K [0.964 0.719]; G = [0.636; 0.570]; 

syms z, T = 0.1; 

Dce = z*K*inv((z*eye (2) -A+G*C*A+B*K-G*C*B*K) ) *G; 

[n,d] = nice(Dce,z); Dce = tf(n,d,T) 

Sys=ss(A,B,C,0,T); [num,den,T] =tfdata (Sys); 

Gz = tf (num, den,T) 

Tz=feedback (Dce*Gz,1) ; 

[Gm, Pm] = margin(Dce*Gz); GmdB = 20*log10(Gm), Pm 
Stepinfo = stepinfo(Tz) 


It is informative to consider the IH-LQG design as depicted in Fig. 11-6. In this figure all signals 
shown are vectors; hence the order of multiplication is important. Any simplification on the 
block diagram must be performed with care. This block diagram can be derived from (11-87), 
if k is replaced with (k + 1). First, the second equation of (11-87) is substituted in the first one. 


q(k + 1) = Aq(k) + [B — GCB]u(k) + Gy(k + 1) — GCAq(k) 


U(Z) X(z) Y(z) 
x =| (zl Ay! > C [1 
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FIGURE 11-6 IH-LQG control system. 
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Taking the z-transform of this equation and rearranging yields 
(zI — A)Q(z) = [B — GCB]U(z) + zGY(z) — GCAQ(z) 
Hence 
Q(z) = (al — A) '{[B — GCB]U(z) + zGY(z) — GCAQ(z)} 


This is seen to be the equation for Q(z) at the output of the Kalman filter in Fig. 11-6. 

The IH-LQG control system as represented in Fig. 11-6 is important in understanding the 
effects of the Kalman filter on the control system. It is seen that the Kalman filter has two inputs. 
One input is the plant input U(z) and the other is the plant output Y(z). If the measurements are 
specified as being very noisy [the effects of the measurement noise on the estimation is much 
greater than the effects of the plant disturbances], the resulting value of G will reduce the effects 
of the measurements on the state estimates, relative to the effects of the plant input and the plant 
dynamics. For example, if there are no plant disturbances (R,, = 0), the steady-state Kalman fil- 
ter will completely ignore the measurements (G = 0) [5]. Of course, this is not desirable under 
any conditions. 

Conversely, if the disturbances on the plant are large, the resulting value of G will increase 
the effects of the measurements on the state estimates, and U(z) and the plant dynamics will have 
less effect. In some cases R,, is purposely increased to indicate model uncertainty. 

It is shown in [9] that the stability margins for the system in Fig. 11-6 when opened at 
point a are always satisfactory. However, the stability margins for the system opened at point b 
may be quite small. Since the plant model is always suspect, we require large stability margins 
at point b. 

A procedure is given in [9] for increasing the stability margins at point b, if these margins 
are small. This is accomplished by increasing the covariance matrix R,, relative to its specified 
value; however, this increase must be performed in a prescribed manner. The stability margins 
can be increased, but the resulting Kalman filter is no longer optimal for the original specifica- 
tions. Hence it is necessary to trade-off optimality for stability. Trade-offs of this type are not 
unusual in applying any theory to physical systems. 


11.8 LEAST-SQUARES MINIMIZATION 


The optimal procedures presented in Chapters 10 and 11 are all based on least-squares minimiza- 
tion, and hence are related. To show the similarities of the procedures, the equations are listed 
in Table 11-1 for LQ design, least-squares system identification, and Kalman-filter design. The 
similarities are evident. 


11.9 SUMMARY 


Presented in this chapter were some basic results in linear quadratic optimal control design. 
Once the cost function has been chosen, the design involves the straightforward solution of a 
difference equation. Even though the basic formulation is for a finite-time problem, the design 
procedure is easily extended to the infinite-time problem. The design implementation requires 
full-state feedback, with the feedback gains time varying for the finite-time problem and con- 
stant for the infinite-time problem, provided that the plant is time invariant. 
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TABLE 11.1 Least-Squares Design Equations 


Cost Functions 


N 

LQ Jy = SY XHOx + u (KHRuk)] 
k=0 
N 

Sys. Id. J= X ek) = (belk) 
k=n 
N 

Kalman J(k) = X Ele?(k)] = Ele™(ke(k)] 
i=0 


Gain Equations 


LQ K(k) = [R + B’P(K + 1)B] 'B’P(K + 1)A 
Sys.Id. Lik + 1) = PEK + DU + f'k + DPO fk + DT! 
Kalman G(k) = M()C7[R, + CM(K)C7]! 

Update Equations 

LQ P(k) = AP(k + DIA — BK(AK)] + Q 

Sys. Id. P(k + 1) = [I — L(k + fk + DIP) 

Kalman M(k + 1) = A[I — G()CIM(A)A’ + B,R,BI 


As the final topic, optimal state estimation by Kalman filtering was presented. This filter 
is a form of the current observer developed in Chapter 9; the only difference is the procedure for 
calculating the gain matrix G. The infinite-horizon linear-quadratic-Gaussian (IH-LQG) design 


was then described. 
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Problems 


11.4-1. 
11.4-2. 


11.4-3. 


11.4-4. 


11.4-5. 


11.4-6. 


Given that (11-21) and (11-22) are valid, derive (11-23). 
Show that (11-35) can also be expressed as 


P(N — m) = A[P(N -m + 1) P(N — m + 1)BDB’P(N — m+ DIA+Q 


where D = [B’P(V — m+ 1)B+ RJ". 
Given the discrete system 


x(k + 1) = Ax(k) + Bu(k) 
with the cost function 


N 
Jy = X x(HQx(k) + u(K)Ru(k) 
k=0 


show that the optimal gains which minimize Jy are unchanged if the elements both in Q and in R are mul- 
tiplied by the positive scalar B. 
Given the first-order plant described by 


x(k + 1) = 0.6x(k) + 0.5u(k) 
with the cost function 


3 
h= > [2x°(k) + WK] 
k=0 


(a) Calculate the feedback gains required to minimize the cost function, using the partial-differentiation 
procedure of Section 11.3. 

(b) Repeat part (a) using the difference-equation approach of Section 11.4. 

(c) Find the maximum magnitude of u(k) as a function of x(0). 

Given the plant of Problem 11.4-4, with the cost function 


3 
h= >) 2x°(K) 
K=0 

(a) Calculate the feedback gains required to minimize the cost function, using the difference-equation 

approach of Section 11.4. 
(b) Find the maximum magnitude of u(k) as a function of x(0). 
(c) Compare the maximum magnitude of u(k) in part (b) with the value in Problem 11.4-4(c). Explain the 

difference. 
A satellite control system is modeled as shown in Fig. P11.4-6. This system is described in Problem 1.4-1. 
For this problem, ignore the sensor gain and let D(z) = 1. In addition, K = 1, T = 1 s, and J = 4. As 
stated in Problem 9.2-4, a state model for this system is given by 


1 1 0.125 
x(k + 1) = k kw + be lw 
yk) = [1 Ok) 


where x(k) is angular position and x2(k) is angular velocity. 
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(a) Determine by hand the gains required to minimize the cost function 


N 


w= > vw) rhw + 2u(k) 
k=0 0 1 


with N = 1. The value of N is chosen to be unity to limit the calculations. 
(b) Use MATLAB to solve part (a) for N = 20. Sketch the calculated gains versus k. 


Digital Amplifier and 
controller thrusters Satellite 
R(s) + Ms) T(s) 1 @O(s) 
A/D D(z) D/A K -A 
r(t) Torque Js“ 0(t) 
Sensor 
H, |« 
FIGURE P11.4-6 Block diagram for a satellite control system. 


11.4-7. 


11.4-8. 


(a) Repeat Problem 11.4-6 for minimizing the cost function 


Z T, 1 0 2 
Jy = > x (k) x(k) + 20u (k) 
k=0 0 1 


Plot the gains on the graph from Problem 11.4-6(c) 
(b) Explain the differences in the gains in part (a) and those in Problem 11.4-6. 
Consider the third-order continuous-time LTI system 


x = Ax + Bu 
y = Cx 
0 2 0 0 
with A = | 0 0 3|,B=|0|,andC=[1 0 Oj. Using 
0 -8 -6 1 
8 0 0 
Q=/0 6 0j, R=15 
0 0 4 


(a) First design a LQ controller for this continuous time-system using the MATLAB function /qr. Let the 
optimal controller gain vector be K. Simulate the closed-loop system 


x = (A — BK)x 


with X(0) = [2 0 —2]. Sample the closed-loop output response y(t) with sampling time T = 0.2 s. 
(b) Next, discretize the continuous-time system directly with sampling time T = 0.2 s and design a 
LQ controller for this discrete-time LTI system with the same Q and R as in part (a). Compare the 
closed-loop output response with the sampled continuous-time output obtained in part (a). 
(c) Increase Q and R by a factor of 10 and repeat both the continuous-time and discrete-time designs. 
Describe how the respective output responses change. 
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11.4-9. A chamber temperature control system is modeled as shown in Fig. P11.4-8. This system is described in 
Problem 1.6-1. For this problem, ignore the disturbance input, T = 0.6 s and let D(z) = 1. It was shown 
in Problem 9.2-3 that the plant state model is given by 


x(k + 1) = 0.7408x(k) + 1.0368u(k) 


Let the cost function be given by 


3 
J = X 2h + wh) 
k=0 


(a) Calculate the feedback gains required to minimize the cost function, using the partial-differentiation 
procedure of Section 11.3. 

(b) Repeat part (a), using the difference-equation approach of Section 11.4. 

(c) Find the maximum magnitude of u(k) as a function of x(0). 


Chamber 


Disturbance 
RAs) 


Controller 
R(s) + 1=< C(s) 
D(z) > 
pi T y i 
Sensor 
Volts 0.04 


FIGURE P11.4-8 Chamber temperature control system. 
11.4-10. Given the plant of Problem 11.4-9, with the cost function 


3 
J = X, 10x7(k) + (k) 
k=0 


(a) Calculate the feedback gains required to minimize the cost function, using the difference-equation 
approach of Section 11.4. 
(b) Find the maximum magnitude of u(k) as a function of x(0). 
(c) Compare the maximum magnitude of u(k) in part (b) with the value in Problem 11.4-9(c). Explain the 
difference. 
11.4-11. Given a general first-order plant described by 


x(k + 1) = Ax(k) + Bu(k) 
with the cost function 


N 
Jy = X [QK + R (k)] 
k=0 
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(a) Show that for R = 0, the optimal gain K(k) is constant for allk = 0. 

(b) Give the input sequence u(k), k = 0, for part (a), where u(k) is a function of x(0). 

(c) Draw a flow graph of the closed-loop system for part (a). 

(d) Give the closed-loop characteristic equation for part (a). 

(e) How many sample periods are required for x(k), with initial condition x(0), to be driven to zero? 
11.6-1. It is shown in [6] that given the partitioned matrix 


where each partition is n X n, the determinant of H is given by 
|H| = |G||D — EG'F| = |D||G — FD'E| 


Show that the determinant of H in (11-49) is equal to unity. Considering the development in Section 11.6, 
is this result expected? 
11.6-2. Give a first-order time-invariant discrete system with a cost function 


N 
In = > Ox (k) + Rik) 
k=0 


Show that the optimal gains are a function of only the ratio 


and not of Q and R singly. 
11.6-3. Consider the system of Problem 11.4-4. 
(a) Find the feedback gain required to minimize the given cost function for the infinite-time problem. 
(b) Find the closed-loop system characteristic equation. 
(c) Find the closed-loop time constant t as a function of the sample period T. 
11.6-4. Consider the system of Problem 11.4-5. 
(a) Find the feedback gain required to minimize the given cost function for the infinite-time problem. 
(b) Find the closed-loop system characteristic equation. 
(c) Find the closed-loop time constant 7 as a function of the sample period T. 
(d) Why is the settling time in part (c) less than that found in Problem 11.4-6(c), where t = 0.410T. 
11.6-5. Consider the satellite control system of Problem 11.4-6. 
(a) By computer, find the feedback gains required to minimize the given cost function for the infinite-time 
problem. 
(b) Find the closed-loop system characteristic equation. 
(c) Find the closed-loop time constants as a function of the sample period T. 
11.6-6. Consider the satellite control system of Problem 11.4-7. 
(a) By computer, find the feedback gains required to minimize the given cost function for the infinite-time 
problem. 
(b) Find the closed-loop system characteristic equation. 
(c) Find the closed-loop time constants as a function of the sample period T. 
(d) Compare the time constants in part (c) with the value in Problem 11.6-5(c), which was t = 3.24T. 
Explain the difference. 
11.6-7. Consider the system of Problem 11.4-9. 
(a) Find the feedback gain required to minimize the given cost function for the infinite-time problem. 
(b) Find the closed-loop system characteristic equation. 
(c) Find the closed-loop time constant. 


452 


11.6-8. 


11.7-1. 


11.7-2. 


11.7-3. 
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Consider the system of Problem 11.4-10. 

(a) Find the feedback gain required to minimize the given cost function for the infinite-time problem. 
(b) Find the closed-loop system characteristic equation. 

(c) Find the closed-loop time constant. 

(d) Compare the gain in part (b) with the value in Problem 11.6-3(a). Explain the difference. 
Suppose that a plant is described by 


x(k + 1) = 0.8x(k) + 0.2u(k) + w(K),  T=0.2s 
y(k) = x(k) + v(k) 


where w(k) and v(k) are random and uncorrelated, with Gaussian distributions, and 
E[w(k)] = 0, Elw(jyw(k)] = 284 
E[v(k)] = 0, EvO] = 8; 


(a) Design a Kalman filter for this system. Continue the gain calculations until the gain is approximately 
constant. Use M(0) = 2. 

(b) In part (a), we specified M(0) = 2. What are we stating about our estimate of the state x(0) ? 

(c) Write the difference equations for the steady-state Kalman filter, as in part (a). 

(d) Suppose that an LQ design is performed for this plant, with the resulting gain K = 0.2197. Find the 
control-estimator transfer function (see Fig. 9-8) for this IH-LQG design. 

(e) Find the closed-loop system characteristic equation for part (d). 

(f) Find the closed-loop system time constants. 

(g) Suppose that the state x(k) is estimated to be 90.1 by the Kalman filter at a certain time kT. Give the 
three-sigma range about the value 90.1 that will almost certainly contain the true value of x(k) at that 
time kT. 

(h) Find the system phase and gain margins. 

The Kalman filter design in Problem 11.7-1 resulted in the steady-state filter equations 


qk) = qk) + 0.71050 — G(k)] 
Gk + 1) = 0.8q(k) + 0.2u(k) 


(a) Consider the plant and filter to be open-loop; that is, the state estimate is not fed back for control pur- 
poses. Suppose that the input u(k) is constant at a value of 10. Find the steady-state values of the plant 
state x(k) and the plant output y(A), if the random inputs w(k) and v(k) are zero. 

(b) For the conditions specified in part (a), find the steady-state value of q(k), the plant state estimate. 

(c) The steady-state Kalman filter has the property that Q(z)/U(z) = X(z)/U(z). Does this property verify 
your results in parts (a) and (b)? 

(d) The Kalman filter requires that the average value of w(k) be zero. Suppose that w(k) is constant with a 
value of 5. Repeat parts (a) and (b), and calculate the percent error in the state estimate. 

Consider the system of Problem 11.7-1. 

(a) Suppose that all specifications are the same, except E[w(j)w(k)] = 0; that is, there are no random plant 
disturbances. Design a Kalman filter and estimate the steady-state Kalman gain from the trends of the 
calculations. Use M(O) = 2. 

(b) Write the difference for the steady-state Kalman filter. 

(c) In part (a), P(k) — 0 in the steady-state. Hence the errors in the estimation of the state go to zero in the 
steady-state (perfect estimation). Since the measurements are noisy, how can the estimation error be 
zero? 

(d) Repeat parts (a), (b), and (c) for the case that R, = 2 and R, = O. In repeating part (c), the measure- 
ments are perfect, but the plant has a random disturbance. 


11.7-4. 


11.7-5. 


11.7-6. 
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Consider the satellite described in Problem 11.4-8. The plant model is given as 


1 0 0.111 0.02 
x(k + 1) = FE kw + bee w + P pw 


yk) = [1 Ok) + (W 


The plant disturbances are caused by random variations in the Earth’s gravity field. Suppose that R,, = 1 

and R, = 0.02. 

(a) The measurement y(k) is in the units of angular degrees and is obtained from a stable platform. Describe 
the accuracy of this measurement; that is, what does the value of R, tell us about the sensor accuracy? 

(b) Calculate and plot the Kalman gains, as in Fig. 11-5, using M(0) = I. 

(c) The diagonal elements of the steady-state error covariance matrix are 


_ [0.00543 — 


Ps 
f — 0.0286 


Comment on the steady-state accuracy of this Kalman filter. 
(d) The LQ design of Problem 11.4-8 yielded the steady-state gains of K = [0.51922.103]. Find the trans- 
fer function D,,(z) of the control estimator. 
(e) Calculate and plot the Nyquist diagram for the closed-loop system opened at the plant input. What are 
the phase and gain margins? 
The system considered here is the classical system of Doyle and Stein [9] to illustrate robustness problems. 
The system of Doyle and Stein is analog; the discrete model of the system is used here [11]. The sample 
period, T = 0.006 s, was chosen small so that the results approximate those of Doyle and Stein. The plant 
model is given by 
0.999946 0.592847E — “| po = | | 0.208907 
x(k) + u(k) + 


k+1)= 
x(k + D= | 01778548 - 1 0.976233 0.592847E — 2 —0.383511 


yk) =P 1% + vk) 


bw 


(a) A pole-placement design is to yield closed-loop poles ats = —7 + j2. Show that these s-plane poles 
translate into the desired characteristic equation 


a(z) = 2 — 1.917602z + 0.919431 = 0 


(b) Find the gain matrix required to place the poles at the locations given in part (a). 

(c) Find the steady-state Kalman filter gains for the case that R, = R, = 166.67. 

(d) Find the plant transfer function G(z) and the control-estimator transfer function D,,(z). 

(e) Using the transfer functions of part (d), plot the Nyquist diagram for the system opened at the plant. 

(f) Find the system phase and gain margins. Doyle and Stein found the phase margin of the analog system 
to be approximately 15°. 

For the IH-LQG control system of Fig. 11-6, suppose that the plant is single-input single-output, such that 

B and C are vectors. To determine the system robustness, the open-loop transfer functions for the system 

opened at a and opened at b must be determined. 

(a) Find the open-loop transfer function for the system opened at the point a. 

(b) Find the open-loop transfer function for the system opened at the point b. 

(c) Give the transfer functions for the frequency responses that must be calculated to determine robustness. 
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12.1 INTRODUCTION 


This chapter presents five case studies of digital control systems that have been imple- 
mented. Two of the control systems were designed using the frequency-response techniques 
of Chapter 8, and the design of the third, even though empirical, was based on the techniques 
of Chapter 8. 

The first case study is a second-order position control system (servomotor) for which 
both a phase-lead and a phase-lag controller were designed. The responses are compared. 
Sampling rate selection is discussed, and certain significant effects from plant nonlinearities 
are noted. 

The second system studied is an environmental chamber control system, which is com- 
posed of a temperature control system, a carbon dioxide control system, a chamber water-loss 
monitor, an outside rainfall monitor, and a data acquisition system. The temperature system 
controller is a PID compensator; the carbon dioxide system controller is a quasi-proportional 
compensator. 

The third case study is the lateral control system of an automatic aircraft landing system 
for U.S. Marine fighter aircraft. The plant for this control system is the aircraft lateral dynam- 
ics, including the bank autopilot, and is ninth order. The digital controller generates bank com- 
mands into the autopilot, and the aircraft position is determined by a phased array radar. The 
system contains significant noise and disturbance inputs, which must be considered in the con- 
troller design. The digital controller is a PID compensator plus added filtering to reduce noise 
effects. 

The fourth case study uses PID design methods to control oxygen delivery to a new- 
born infant being supported in an incubator. Various models of the system components are 
described, and several sampling rates are explored to assess their impact on system performance. 
MATLAB’s pidtool is used for compensator design. 

The fifth case study uses system identification to model a portion of a larger power system 
network. MATLAB’s Power System Analysis Toolbox (PSAT) is used for system simulation, 
and CVX software package is used for convex optimization. 


12.2 SERVOMOTOR SYSTEM 


The design of a digitally controlled servomotor system [1] is presented in this section. This sys- 
tem is low order and presents no particular design nor implementation difficulties. However, the 
system does contain nonlinearities that have an observable influence on system response. These 


nonlinear effects will be discussed as they are encountered. 


The control-system block diagram is shown in Fig. 12-1 and the system hardware con- 
figuration is given in Fig. 12-2. The Texas Instruments TI9900 microprocessor system [2] was 
chosen for the implementation of the digital controller. At the time of the system design, this 
microprocessor system was one of the few 16-bit processors available. In addition, the processor 
has hardware multiplication, and software support is available. The terminal indicated in Fig. 12-1 
was chosen to be a Texas Instruments Microterminal [2] and is used to initialize the system, 


change filter parameters if desired, test system operation, and so on. 


Terminal 


12.2 Servomotor System 


T19900 
system 


D/A 


Servomotor 
system 


Digital controller 


FIGURE 12-1 System block diagram. 
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FIGURE 12-2 System hardware. 
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o 
Sign Integer Assumed Fractional 
flag part binary part 
point 


FIGURE 12-3 Computer data format. 


The data (number) format for data internal to the computer is shown in Fig. 12-3 and is 
fixed-point format. The magnitudes of both the fractional part and the integer part of numbers 
are presented by 16 bits. Thus the dynamic range is from a (nonzero) minimum of [3] 


2716 = 0.000015 


to a maximum of 
Qe = 1 integer a Gh 2 S een = 65,535.999985 


The 32-bit precision is not needed for this application. It was chosen to facilitate data manipu- 
lations, since processing time is abundant. In addition, the sign flag was placed external to the 
integer part of the number to facilitate multiplication. The filter coefficients are stored in sign- 
magnitude format, which is the form required for the multiplication hardware. 


System Model 


The control system can be mathematically modeled as shown in Fig. 12-4. 

A first step in the design process was to determine the plant transfer function Gp(s). This 
transfer function was obtained experimentally by removing the digital controller, the A/D, and 
the D/A shown in Fig. 12-2. Thus, in this figure, points A and B were connected. Since the ser- 
vomotor is dc and armature-controlled, the plant transfer function was assumed to be [4] 


On 
G,(s) = sG + 250,) (12-1) 
giving a closed-loop transfer function of 
ea E (12-2) 


1 + G,(s) oe 28w,5 + o? 
Thus the system frequency response is given by 


w2 


7 12-3 
(o2 — o?) + j260,0 ( ) 


T(jw) = 


FIGURE 12-4 Control system model. 


12.2 Servomotor System 


To obtain the system model experimentally, a sinusoid was applied to the system and the fre- 
quency varied until the system output lagged the input by 90° in phase. As seen from (12-3), this 
frequency is w,. The amplitude of the response at this frequency was then used to calculate 5. 
The resulting transfer function was found to be 


36 


nS 
(24365 4 36 


(12-4) 


Next a value for the sample period, T, was determined experimentally. One criterion 
that has been used successfully is to choose T as approximately one-tenth of the system rise 
time [5, 6]. The system step response is recorded in Fig. 12-5, indicating a rise time of approxi- 
mately 0.3 s. Thus a sample period of 30 ms is a value for consideration. 

To test this sample period, the system was connected with the microcomputer in the loop, as 
shown in Fig. 12-1. The computer was programmed to be a simple gain of unity (i.e., the A/D, com- 
puter, and D/A performed the function of a sampler and zero-order hold). The step response was 
then run for several values of T in the vicinity of T equal to 30 ms. The results are given in Fig. 12-6. 

First, note that the response for a sample period of 5 ms is quite close to that of the ana- 
log system (see Fig. 12-5). Next note that the system is approaching instability for T = 40 ms. 
However, the small amplitude of the oscillation indicates a nonlinear effect, since generally a lin- 
ear system oscillation triggered by a step input will have approximately the amplitude of the step. 
An investigation of this system determined that a jump resonance nonlinearity [7], usually caused 
by saturation, is present in the system. Jump resonance has been shown to produce limit cycles in 
sampled-data systems of this type [8]. Thus, for this system, the sampling rate is determined not 
by linear sampling theory, but by a system nonlinearity. It should be pointed out that a servo sys- 
tem is often designed such that the servoamplifier is saturated for a large percentage of the time. 
Thus the motor input voltage is maximum during this time, ensuring maximum speed of response. 

Consideration of the step responses in Fig. 12-6 resulted in a choice for T of 5 ms. With 
this value of T, we can calculate G(z). From (12-2) and (12-4), 


36 
G,(s) = s(s + 3.6) (12-5) 


Then 


361 — © ™)] _ 0.00044731z + 0.00044739 
a | = z (12-6) 


G am 
© | As + 3.6) | 2 — 1.982161z + 0.982161 


c(t) (V) 


—————— 
| t (10 mm/s) 


FIGURE 12-5 Step response of the servomotor system. 
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FIGURE 12-6 Step response of the servomotor for different sampling periods: (a) T = 5 ms; 
(b) T = 10 ms; (c) T = 20 ms; (d) T = 30 ms; (e) T = 40 ms. 
The closed-loop transfer function is then 


G(z) __ 0.00044731z + 0.00044739 
1 + Gz z? — 1.981714z + 0.982608 


(12-7) 


Note the numerical problems. At low frequencies (in the vicinity of z = 1), the frequency 
response is determined principally by the last digit of the numerator coefficients, and thus 
numerical inaccuracies will be present. These numerical problems are caused by using a sam- 
pling frequency that is very large compared with the system natural frequencies. To calculate the 
frequency response from (12-6) and (12-7), numerical accuracy greater than that shown must 
be employed. However, use of (7-23) to calculate the frequency response circumvents these 
problems. 

Shown in Fig. 12-7 is the measured system frequency response and also the frequency 
response of an analog (linear) computer simulation of the system. 


12.2 Servomotor System 
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FIGURE 12-7 Closed-loop frequency response. D(z) = 1, T = 0.005 s. 


The system frequency response in the vicinity of the resonance peak is actually double val- 
ued, because of the jump resonance effects [7], but is shown as being single valued. Since both 
of these curves were obtained experimentally, they are plotted versus real, or s-plane, frequency. 
The w-plane frequency is obtained from (7-10): 


2 of 
o, = 7 tan (12-8) 


Design 


The frequency response for G(z), obtained using (7-23), is plotted in Fig. 12-8. 
As described in Chapter 8, phase lead design is principally trial and error. Use of the pro- 
cedure of Chapter 8 resulted in a phase-lead filter transfer function of 


0.693(1 + w/2.21) 


Dw) = 12-9 
(w) 1 + w/44.8 e 
and thus, from (8-14), 
12.74z — 12.6 
pw = Bie 26 12-10 
@) z — 0.798 call 


The computer calculates 
mnT) = 12.74e(nT) — 12.6e(nT — T) + 0.798m(nT — T) 


The resulting phase margin was 80°. The system closed-loop frequency response is given in 
Fig. 12-9. Both responses were obtained experimentally. The analog computer simulation, with 
filter, was linear; thus the closeness of the two responses indicates little nonlinear effects in the 
system. The system step response is given in Fig. 12-10. 
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FIGURE 12-8 Open-loop frequency response. T = 0.005 s. 
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FIGURE 12-9 Closed-loop frequency response with phase-lead compensation (T = 5ms). 


A phase-lag filter was also designed, using the procedure given in Chapter 8. The resultant 
filter transfer function is 


Diy — 1360 + w/0.20) ie 
M= T w/0.044 (a) 
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FIGURE 12-10 Step response of the servomotor system with a phase-lead compensator (T = 5ms). 


and thus 


0.3z — 0.2997 
p= 12-12 
© = 9.99978 RE 


Here the computer calculates 
y(nT) = 0.3x(nT) — 0.2997x(nT — T) + 0.99978y(nT — T) 


The phase margin for this system is 60°. However, when the frequency responses were obtained 
experimentally, the curves in Fig. 12-11 resulted. Here the differences in the frequency responses 
indicate gross nonlinear effects. The system step response is given in Fig. 12-12. 


12.3 ENVIRONMENTAL CHAMBER CONTROL SYSTEM 


This section presents the case study of a digital control system for an environmental chamber 
designed for the study of plant growth [9]. Two control systems were implemented: one to con- 
trol dry-bulb temperature and the other to control the carbon dioxide (CO3) content in the cham- 
ber atmosphere. The chamber is constructed of plexiglass with measurements of approximately 
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FIGURE 12-11 Closed-loop frequency response with phase-lag compensation (T = 5ms). 
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FIGURE 12-12 Step response of the servomotor system with a phase-lag compensator (T = 5 ms). 


0.7 by 1.3 by 2 m. The chamber system is hermetically sealed such that both moisture content 
and carbon dioxide content can be accurately monitored. 

Fig. 12-13 gives a hardware description of the temperature control system. The chamber 
is cooled (air conditioned) to the extent that heaters are required to maintain the desired tem- 
perature. Thus the heaters are the controlling elements in the closed-loop system. The resis- 
tance bridge is dictated by the temperature sensor used, and has an output in the millivolt range. 
An operational amplifier increases the amplitude of this signal to the +5-V range required by 
the A/D converter. The measured temperature is then subtracted from the desired temperature, 
which is stored in the TMS9900 microcomputer system. Next this error signal is processed by 
the TMS9900 (the system compensation), resulting in an output signal to the heater interface. 
The heater interface is a complex logic circuit [9] that converts the computer output signal into 
the triacs’ [10] control pulses. The triacs control the electrical energy into the heaters by in effect 
controlling the rms voltage applied to the heaters. 

The hardware description of the CO, control system is given in Fig. 12-14. The CO, con- 
tent of the chamber atmosphere is measured by the gas analyzer in parts per million (ppm). This 
signal is compared with the desired set point, and if the error is negative (a CO, deficit), the 
computer opens a solenoid value from a CO, supply for a length of time dependent on the error 
magnitude. The control system has no capability to remove excess CO}. Because of the time lag 
required for the gas analysis, the sampling rate for this control system cannot be greater than 
0.0222 (T = 45 s). In addition, no compensation is employed. However, as will be shown later, 
satisfactory control occurs. 
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FIGURE 12-13 Chamber temperature control hardware diagram. 
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FIGURE 12-14 CO, control hardware. 


Temperature Control System 


The temperature control system was designed empirically. Because of the complexity of the 
system, no attempt was made to derive a plant model. Instead, a step response was run between 
the heater input and the temperature sensor output. The temperature rise was found to be 
approximately exponential with a time constant of 60 s. Thus as a first try, the sample period 
was set to 6 s. 

To aid in the empirical design, a proportional-plus-integral-plus-derivative (PID) control- 
ler was chosen for implementation (see Chapter 8). The analog version of the PID filter is 


de(t) 
dt 


m(t) = Kpe(t) + Kı |: e(f)dt + Kp (12-13) 


where e(t) is the controller input and m(t) is the controller output. The discrete controller imple- 
mentation of the integrator was chosen to be 


mj(k) = 


Teo + e(k — 1)] + mk — 1) (12-14) 


and for the differentiator, 


1 
mak) = Fe% — ek- D] (12-15) 


[see (8-34) and (8-37)]. Hence the discrete controller implementation of (12-13) is 
m(k) = Kpe(k) + Kym(k) + Kpmg(k) (12-16) 
It is evident from these equations that four parameters are to be determined: T, Kp, K;, and Kp. 


However, if an appropriate choice is made for T such that accurate differentiation and integra- 
tion occur, the parameters Kp, K;, and Kp will be independent of T. 
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The hardware for the temperature control system was chosen prior to design of the 
controller. In many applications the control system designer will find predefined hardware con- 
straints, and must learn to adapt his design techniques, from ideal to practical. Two heaters were 
specified: one with a slow response (large mass) and one with a faster response (smaller mass). 
Thus the slow-response heater adds phase lag to the system, which is undesirable. Subsequently, 
experimentation on the physical system resulted in a choice for the form of the controller as 
shown in Fig. 12-15. Different PID gains (P1, I1, D1 equivalent to Kp, K;, Kp, respectively) are 
implemented for the fast-response heater [controlled by the signal c,(k)] from those employed 
with the slow-response heater, which is controlled by c,(k). This form for the controller results 
in a better system response than that obtained by controlling both heaters with a single signal. 

The controller gains were determined by first implementing a proportional-only controller, 
and varying P1 and P2 in Fig. 12-15. A typical step response is given in Fig. 12-16, with P1 and 
P2 both equal to 25. 

The small oscillation visible in this response is caused by the air conditioner cycling on 
and off. The control system was commanded to a 10° Celsius step input, from 25°C to 35°C. 
Note the steady-state error in Fig. 12-16. During these tests, the sample period T (Ts in Fig. 12-16) 
was also varied, and a value of T = 1 s was chosen; that is, choosing T less than 1 s caused no 
observable improvement in the system response. 

Next the integral term was added to the controller, and a typical step response is given in 
Fig. 12-17. 

Note the elimination of the steady-state error, as expected (see Section 8.9). Finally, the 
derivative term was added to the controller, resulting in a typical response as shown in Fig. 12-18. 

Note that no improvement occurs in the rise time for the PID controller, because the heat- 
ers are full on for large error signals for both the P controller and the PI controller (a nonlinear 
effect). Thus the system cannot respond any faster for large errors and this effect is independent 
of the form of the controller. However, for small errors (e.g., small overshoot), the derivative 
term in the controller has a definite and predictable effect (normal linear operation). 


mj(k) 
m| Integrator ~ 


e(k) elk) | 


c4(k) 


ca(k) 


mak) 


Differentiator 


where e(k) = error at t= kT 
mk) = T/2 e(k) + T/2 e(k — 1) + mk — 1) 
mk) = 1/T e(k) — 1/T e(k— 1) 


FIGURE 12-15 Block diagram of PID filter implementation. 
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FIGURE 12-17 PI controller step response behavior. 


In all the tests above, both heaters were controlled by the same signal. Attempts to increase 
the derivative signal beyond certain values while using this strategy resulted in a tendency 
toward instability. This effect is predictable, since the maximum phase lead attainable from a 
PID controller is 90°, but the gain may be increased without limit (theoretically). At this point, 
the PID gains for the fast heater were varied from those for the slow heater in order to reduce 
overshoot and settling time. The final values for the filter gains were chosen to be: P1 = 100, 
I1 = 0.3, D1 = 100, P2 = 25, I2 = 0.25, D2 = 25, andT = 1s. 

A typical 24-hour system response is given in Fig. 12-19. Time equal to zero is midnight. 
The carbon dioxide can be controlled only during daylight hours, since plants emit CO, at night. 
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FIGURE 12-19 Chamber behavior for normal operating conditions. 
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12.4 Aircraft Landing System 


For this figure, the temperature was commanded to follow a triangular wave which is an approxi- 
mation to actual temperature variations during a typical 24-hour period. 


12.4 AIRCRAFT LANDING SYSTEM 


This section presents the design of an automatic aircraft landing system. The particular control 
system described is that of the Marine Air Traffic Control and Landing System (MATCALS) 
[12, 13]. The system is illustrated in Fig. 12-20. The radar (the control system sensor) employs a 
phased array antenna, which was chosen because the radar beam can be rapidly repositioned to 
control a number of planes at sampling rates of up to 40 Hz. However, the positional information 
provided by the radar system is corrupted with significant noise, which presents problems to the 
control system designer. 

The control operation is composed of two independent (decoupled) control systems: the 
vertical control system, which keeps the plane on a 3.5° glide slope, and the lateral control 
system, which maintains the plane on the extended centerline of the runway. These two control 
systems are illustrated in Fig. 12-21. Two separate computer-processing algorithms are utilized 
in each control system. The first algorithm processes the antenna return signals to determine the 
aircraft position (centroid position) with respect to the runway touchdown point. The second 
algorithm comprises the difference equations that describe the digital controllers. The outputs 
of the controllers are transmitted via a data link to the aircraft and applied to the appropriate 
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FIGURE 12-20 Aircraft landing system. 
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FIGURE 12-21 MATCALS automatic landing control loops. 


autopilot inputs: the pitch autopilot for the vertical control system and the bank autopilot for the 
lateral control system. 

In the following development, only the lateral control system will be discussed. The design 
of the vertical control system follows similar paths of development. 


Plant Model 


A block diagram of the lateral control system is given in Fig. 12-22. The lateral aircraft dynam- 
ics, described by the transfer function G;(s), include the bank autopilot and typically have a 
frequency response as shown in Fig. 12-23. These dynamics are of course aircraft dependent; the 
frequency response of the McDonnell Aircraft Company F4J aircraft is given in Fig. 12-24, and 
was obtained from measurements on the aircraft in flight [14]. The lateral aircraft equations of 
motion will not be developed here (see [15]), but are ninth order for the F4J aircraft with autopi- 
lot included. Note from the —40 dB slope on the magnitude curve of G;(jw) in Fig. 12-24 that 
G(s) has a second-order pole at the origin. 

A sketch of the Nyquist diagram for the F4J aircraft lateral control system is given in 
Fig. 12-25, as can be seen from Fig. 12-24. Since the aircraft with autopilot must be (open-loop) 
stable, it is evident that phase-lead compensation must be employed to eliminate the encircle- 
ment of the —1 point, in order to stabilize the system. 


Design 


There are three significant disturbance sources in the lateral control system which must be con- 
sidered in the system design. The first of these is the radar noise, and is indicated in Fig. 12-22. 
The other two disturbances, which will be considered first, are direct inputs to the aircraft lateral 
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FIGURE 12-22 Lateral control loop. 
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FIGURE 12-24 F4J lateral frequency response (Y/¢,). 


470 


Chapter 12 * Case Studies 


Uncompensated 


Compensated 


FIGURE 12-25 Nyquist diagram of G,(s), and G,(s) with possible compensation. 


dynamics. Thus each of these disturbances may be modeled as shown in Fig. 12-26. Hence the 
influence of the disturbance on the lateral position y(k) is given by 


_  — GpU(Z) 
Y% = TF DOCO Ge) 
where 
1 = e7” 
G(z) = J= Gus) (12-18) 


and, as stated previously, G,(s) has two poles at s = 0, resulting in two poles of G(z) atz = 1. 

One of the disturbances to be modeled as U(s) in (15-17) is a relatively constant error 
(called a dc bias) in the output of a rate gyroscope in the autopilot. This error can be treated as a 
system input. Note that, in general, a constant input for the disturbance in Fig. 12-26 will result 
in a constant output y(k) in the steady state. The aircraft would then land to one side of the run- 
way centerline, which is unacceptable. Thus a system requirement is that the final-value theorem 
when applied to (12-17) yield a value of zero; that is, 


A (z — 1) Gp UK) 
l k) = 12-19 
By) S TEDO a ii 
U(s) | G66) 
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Controller 
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FIGURE 12-26 Lateral control system with a disturbance. 
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FIGURE 12-27 Lateral control system Nyquist diagram. 


with U(s) = 1/s. Now both Gp(s) and G,(s) of Fig. 12-26 have two poles at s = 0. Thus 
GpU (z) has three poles at z = 1, and G(z) has two poles at z = 1. If D(z) is given a pole at 
z = 1, (12-19) is satisfied. Hence a proportional-plus-integral (PI) controller is a system require- 
ment. As was seen from Fig. 12-25, phase lead is required for stability. Since the derivative 
term in the PID controller contributes phase lead [see (8-47)], the PID controller was chosen to 
compensate this system. The compensated-system Nyquist diagram then appears as shown in 
Fig. 12-27. 

The second disturbance source of the type illustrated in Fig. 12-26 is the wind. It is desir- 
able that the aircraft not respond to wind inputs, but of course this is not possible. So the control- 
ler is designed to reduce the effects of wind. Consider again the effect of the wind disturbance as 
modeled in Fig. 12-26 and equation (12-17). Of course, Gp(s) is different for wind disturbances 
from that for the dc bias disturbance. In (12-17), the response is reduced if D(z)G(z) is made 
large in the frequency range of the wind (turbulence) input signal. Since the frequency response 
of G(z) is fixed, D(z) should be designed to increase the system bandwidth. As we have seen 
in Chapter 8, the derivative path of the PID controller not only introduces phase lead, but also 
increases system bandwidth. Hence we require a high gain in the derivative path. 

The third disturbance source, which is the noise present in the radar system output signal, 
is modeled as shown in Fig. 12-22. Note that the radar noise enters the system at the same point 
as does the lateral position command signal. Thus a system design that yields a good response to 
the command input also yields a good response to the radar noise. This noise response is a major 
problem in the design of this system. For aircraft-carrier-based systems [16], a parabolic radar 
antenna system is used. The signal from this type of antenna system is relatively noise-free, and 
the noise problem is not as critical as in the land-based system. 


a-B FILTER. To reduce the effects of the radar noise, an a- tracking filter [17] was chosen to 
filter the radar signal at the controller input. (The a-ß filter equations are given in Problem 2-21.) 
This filter is designed to estimate y(k), the aircraft lateral position, and y(k), the aircraft lateral 
velocity, given a noisy radar system output signal. The estimate y(k) is then transmitted to the posi- 
tion path and the integrator path, and the estimate y(k) to the derivative path, of the PID compensa- 
tor. Thus the PID compensator has the basic configuration shown in Fig. 12-28. 
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FIGURE 12-28 Basic form of the controller. 


The frequency responses plotted versus real frequency w of an a-ß filter are given in Fig. 12-29. 
The sample period is T = 0.1 s; thus w,/2 is 31.4 rad/s. Note that at low frequencies the position fil- 
ter (Fig. 12-29(a)) has unity gain and no phase shift, but it attenuates high-frequency noise. At low 
frequencies the velocity filter response (Fig. 12-29(b)) has a slope of —20 dB/decade, which is equal 
to that of an exact differentiator. However, the phase characteristic varies from that of a differentia- 
tor, which has a constant phase of 90°. This filter also attenuates high-frequency noise. For the filter 
plotted, œ = 0.51 and B = 0.1746, which are the values used in the F4J controller. 
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FIGURE 12-29 (a) a-f position filter response; (b) a-8 velocity filter response. 


12.4 Aircraft Landing System 


Gain (dB) 
cy 


Phase 


0° 


+ -50° 


Phase 


FIGURE 12-30 œ&-filter frequency response. 


a-FILTERS. The noise-reduction characteristics of the a-ß filter do not adequately attenuate 
the radar noise in this system. To reduce the high-frequency noise further, low-pass filters (at 
times called a-filters [16]) are added at various points in the PID controller. The a-filter has a 
transfer function given by 


DO = ——“ —~ (12-20) 
z— (l-a) 


The frequency response of an a-filter for a = 0.234 and T = 0.1 s is given in Fig. 12-30. This 
filter is also employed in the F4J controller. As is normal in low-pass filtering, phase lag is added 
to the system. It is seen from the system Nyquist diagram in Fig. 12-27 that phase lag is already 
a major design problem. Thus the final design must include a trade-off between desired stability 
margins and radar noise rejection. 

The foregoing system requirements resulted in a final filter design illustrated in 
Fig. 12-31. An additional differentiator is added to the y(k) path to produce additional phase 


a — B filter 


a? + (By = ay)z 


2 +(aytBy—Det1—ay 


Oy z 


a _ _ — 
Yeoman | 2° +(@,+B,—22+1-c, Ira i ae 


B,/T e? —2) ý Rate filter Ý A t Piim 4: + 
Ky =| 


Piim 


Acceleration filter g 
2 2-4) ¥ 
ayz -D =| K 
tay- D&T 
Bank filter 30 
by Z Z .— o, 
z+aą„ -1 
“by -30 


FIGURE 12-31 Lateral control system controller. 
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FIGURE 12-32 F4J lateral controller frequency response, T = 0.1 s. 


lead, since that produced by the derivative term was insufficient. The differentiator has the 
transfer function 


z=] 
Tz 


D.Z) = (12-21) 


[see (8-38)]. Because of the high-frequency noise amplification from this differentiation of a 
noisy signal, two sections of a-filter are required for this path. The nonlinearities shown in the 
filter are not exercised during normal system operation. The limits jj, and Yiim, and the various 
gains shown, are all functions of range, with the gains increasing as the aircraft nears touchdown. 
The gains are constant for the final 1500 m of flight. The frequency response (versus real fre- 
quency w) of the lateral controller for the F4J aircraft is given in Fig. 12-32; the standard PID 
filter response is seen, except for the high-frequency attenuation added to reduce noise effects. 

The PID path gains used, for range less than 1500 m, are Kp = 0.1, K; = 0.0033, 
K, = 0.75, and (acceleration path) K, = 0.75. The resultant phase margin is 60°, and the gain 
margin is 8 dB. Two significant nonlinearities in the lateral control system are the mechanical 
limits on the rotations of the ailerons and of the rudder. For a landing in high wind turbulence, 
these nonlinearities are exercised and the stability characteristics are degraded. 


12.5 NEONATAL FRACTIONAL INSPIRED OXYGEN 


In this case study, we examine the performance of PID feedback controllers for neonatal frac- 
tional inspired oxygen [18, 19]. First, we rebuild the model and closed-loop system of Taube 
et al. [20-22] as shown in Fig. 12-33. Then, we use MATLAB’s pidtool to design PIDF control- 
lers at three different sampling intervals. The PIDF controller results are compared with those of 
Taube’s original design. 


Plant Transfer Function 


The main basis for this model was the Sano and Kikuchi model [23]. Some assumptions made by 
the Sano and Kikuchi model are as follows: 
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PID controller of Taube 


[Blender delay 20 s] 
PiO2 FiO2 
r(k) T(z+1) +| uk) 1 1 | u(k-2) 1 K, 
KI >) + >) >| = [L] >| | o—| 
+ 2(z-1) + z z Tarl T stl 
Rate T Discrete-time i r N a z 
80 mmHe integrator Unit delay Unit delay! Zero-order Hood Baby Scope 
= = i hold 
> =| Tz =| Pa02 
Derivative2 To workspace 
Pa02(k) 
KP, Proportional gain of PID controller FiO2, Fractional inspired oxygen 
KI, Integral gain of PID controller PaO2, Blood partial pressure of oxygen 
KD, Derivative gain of PID controller Ref = 80 mmHg: Reference signal 
PiO2, Partial fraction of delivered oxygen T = 10s: Sampling interval 


FIGURE 12-33 Closed-loop system model in Simulink. 


1. Rate of respiration and oxygen consumption are constant values. 

2. Mixing of gases present inside the body and the inspired oxygen is instantaneous. 

3. Respiratory exchange ratio (ratio of the number of molecules of oxygen taken in to the 
number of molecules of carbon dioxide breathed out in a single breath) is constant. 


For the mathematical formulation of the analog model of the plant, we consider the blender, 
hood, and the baby separately as in [20]. The transfer functions of the blender, hood, and baby 
are given separately as follows: 


Blender = K,e¢ 7” (12-22) 


The exponential term represents the blender time delay factor in the transportation of oxygen. K, 
is the oxygen blender gain. From experimental results [20], K, = 1.0 and 7, = 20s. 


1 
Hood = ———— 12-23 
™ 1 + THs ( ) 


The term Ty is the hood time constant. This value represents the amount of time taken for oxygen 
from the blender to reach the hood. From [20], its value is 55 s. 


K; 


Baby = ———— 
ue 1+ ts 


(12-24) 


K; is the lung transfer ratio. The parameter T, is the lung time constant. The lung time constant 
represents a constant value of time that is required for an amount of air to be passively exhaled, 
irrespective of the starting volume of air in the lungs. From [20], K; = 90 and q; = 12s. 

So the analog transfer function of the entire plant is now given as 


G,(s) = KiKie ™ (12-25) 
A) Fa ea ae 7 
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Substituting all the constants’ values, the plant transfer function is obtained as 


907s (3/22)e7 


CoS) = T4555 + 129) s? + (67/660) + (1/660) 


(12-26) 


The above model is based on the simplified model proposed in [23] with the following steady- 
state relation between FiO2 and PaO2: 


PaO2 = (K,)FiO2 + K (12-27) 


For an infant suffering severe respiratory distress, K; and K, can be 90 and 0, respectively, 
requiring an oxygen ratio of over 90% to maintain normal blood oxygen levels. The control 
objective is to maintain PaO2 = 80 mmHg: 


Taube’s PID Controller 


The controller for this system developed by Taube is a parameterized PID controller, which has 
some adaptive characteristics [20-22]. The gains and step performance of Taube’s PID control- 
ler can be calculated using the following MATLAB program: 


Kb=1; TH=55; TL=12; KL=90; Tb=20; T= 10; K=KL*Kb; d=1.5*T+Tb; 
KI = 0.5/(K*d) 

a = exp(T/TL); b = exp(T/TH); m = a*b; s = a+b; 

KD = KI/(1+m-s) 

KP = (s-2)*KD 

Dz = tf([KP+KI*T/2+KD/T KI*T/2-KP-2*KD/T KD/T],[1 -1 0],10); 
Dz PID = zpk(Dz) 
baby = tf (KL, [TL 1]); 

hood = tf([1], [TH 1],'inputdelay',20); % hood with 20s delay 
Gp = hood*baby; 

Gz = c2d(Gp,10), 

Cz = feedback (Dz*Gz,1); 

opt = stepDataOptions; 

opt .StepAmplitude = 80; 

step(Cz,1000,opt),grid % Plot Taube Step Response, Ref=80mmHg 
[Gm, Pm] = margin(Dz*Gz); GmdB = 20*log10(Gm), Pm 
disp('Unit-step performance metrics:') 

stepinfo (Cz) 


4.937 z + 3.523 


Z*2 - 1.268 z + 0.3623 


KI = 1.5873e-04 
KD = 6.1189e-04 
KP = 9.1806e-04 


Dz PID = 
0.0017729 (z*2 - 0.1392z + 0.03451) 


The resulting step response is shown in Fig. 12-34. 
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FIGURE 12-34 Step response for proposed system [20-22]. 


The system performance parameters are 


GmdB : 8.0819 
Pm: 35.7669 
RiseTime: 90 
SettlingTime: 780 
SettlingMin: 0.8678 
SettlingMax: 1.3612 
Overshoot: 36.1163 
Undershoot: ) 

Peak: 1.3612 
PeakTime: 250 


© boo See ps Se ee pe Se ee ee ef qe eee 


The settling time is 13 minutes. Our goal is to improve that with some different PID controller 
designs using the MATLAB pidtool as demonstrated in Example 8.6. 


MATLAB pidtool PIDF Controllers 


First, we continue the approach used by Taube [20-22] and choose the sampling interval 


T = 10s so that the blender delay 7, = 2T. Hence, we 


can model the blender delay as z? as 


shown in (4-39). Details are given in the MATLAB program below. Fig. 12-35 shows the pidtool 


results and Fig. 12-36 shows the step response. 


T = 10; 


Gp = t£([3/22], [1 67/660 1/660]); % without 


delay = tf([1],[1 0 0],T); % blender delay 
Gpz = c2d(Gp,T); 

Gz=delay*Gpz 

disp(' ') 


disp('Now opening MATLAB pidtool GUI') 
disp('Set Pm = 64, wwl = 0.0172') % 


blender delay 
= z^(-2) 


Found by trial and error 
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eno z z PID Tuner 
aa aa SVB) @ P Design mode: | Exte... $) Form) Para.. $) Type A 


Plot: Step + Response: | Reference tracking g Show baseline Hide parameters 4 
14 - — ~ ~ > Controller parameters 
Tuned 
Kp 0.013567 
] Ki 0.00018871 
Kd 0.09763 
A spt Ee ond Tf 5.5064 
z Performance and robustness 
$ a7 | } Tuned 
$ | Rise time (seconds) 60 
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Peak 1.02 
4 1 Gain margin (rad/s) 11@0.0589 
Phase margin (rad/s) 64 @ 0.0172 
Closed-loop stability Stable 
—— Tunedresparse | 
i00 isi 200 a0 
Time (seconds) 
Interactive tuning 
Bandwidth: 
(u) e es «= (PP) [0.0172 rad/s 
0.00138 0.0138 0.138 
Phase margin: 
1} 64 deg : 
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?) Close | | Help 


FIGURE 12-35 Screen shot of MATLAB pidtool (T = 10 s). Source: Reprinted with permission from 
The MathWorks, Inc. 
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FIGURE 12-36 Step response for PIDF controller (T = 10s). 
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To get the same results shown below, first increase the 
phase margin to 64 using the up arrow on the value box, then 
Sincrease the bandwidth wwl to 0.0172 using the same procedure 
pidtool (Gz, 'pidf') 


A o 


GZ = 
4.937 Zz + 3.523 


Now opening MATLAB pidtool GUI 
Set Pm = 64, wwl = 0.0172 


% Gains from MATLAB pidtool with Pm = 64, wwl = 0.0172 

T, KP = 0.013567, KI = 0.00018871, KD = 0.09763, TF = 5.5064 
disp('PIDF using Equation (8-65)') %Find Dz using Eqn (8-65) 
Dz_PIDF=KP+(KI*T) *t£((1], [1 -1],T)+KD*tf£([1 -1], [TF -TF+T] ,T) 
Dz PIDF = zpk(Dz PIDF), Dz PIDFGz = Dz PIDF*Gz; 

Cz PIDF = feedback(Dz PIDFGz,1); opt = stepDataOptions; 
opt.StepAmplitude = 80; 

step(Cz_ PIDF,1000,opt),grid sPlot PIDF Step Response, Ref=80mmHg 
disp('PIDF Gain and Phase Margin: ') 

[Gm, Pm] = margin(Dz PIDFGz); GmdB = 20*log10(Gm), Pm 

% disp('Unit-step performance metrics: ') 
PIDF_stepinfo=stepinfo(Cz_ PIDF) 


T = 10 

KP = 0.0136 

KI = 1.8871e-04 
KD = 0.0976 

TF = 5.5064 


PIDF using Equation (8-65) 
Dz PIDF = 
0.031297 (z-0.841) (z-0.3115) 


GmdB: 11.0470 
Pm: 63.9920 
RiseTime: 60 


SettlingTime: 110 
SettlingMin: 0.9207 


SettlingMax: 1.0173 
Overshoot: 1.7342 
Undershoot: 0 
Peak: 1-0173 
PeakTime: 130 


The performance of this PIDF controller is improved with the settling time being reduced 


from 13 minutes to 110 seconds. Noting that the lung time constant of the baby is 12 seconds and our 
sampling interval is 10 seconds, our sampling interval is perhaps too long. So we can choose T = 5 s 
and model our blender delay as z~*. Repeating the PIDF design example with these new parameters 
follows. Fig. 12-37 shows the pidtool tuning window and Fig. 12-38 shows the step response. 


ay a 
Gp = tf([3/22], [1 67/660 1/660]); % without blender delay 
delay = tf([1], [1 0 0 0 0],T); % blender delay = z*(-4) 
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PID Tuner 


aa % % SIG @ p Design mode: | Exte... :) Form | Para... Type : 
Plot: | Step + Response: | Reference tracking Show baseline Hide parameters 4 
14 Controller parameters 
Tuned 
12} Kp 0.018487 
Ki 0.00024205 
1} OAT ee annitn ni pbbbssnmancnnacommmnnt Kd 0.19303 
is T 2.8731 
g 08 
a Performance and robustness 
$ vs Tuned 
Rise time (seconds) 40 
sid | Settling time (seconds) 75 
Overshoot (6) 1.28 
Ji Peak 1.01 
Gain margin (rad/s) 9.17 @ 0.0727 
il i Cime] ase margin ad 64 @ 0.0234 
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FIGURE 12-37 Screen shot of MATLAB pidtool (T = 5 s). Source: Reprinted with permission from 
The MathWorks, Inc. 
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FIGURE 12-38 Step response for PIDF controller (T = 5s). 
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Gpz = c2d(Gp,T); 

Gz=delay*Gpz 

disp(' ') 

disp('Now opening MATLAB pidtool GUI') 


disp('Set Pm = 64, wwl = 0.0234') % Found by trial and error 
pidtool (Gz, 'pidf') 


Gz = 
1.445 Z + 1.22 


% Gains from MATLAB pidtool with Pm = 64, wwl = 0.0234 

T, KP = 0.018487, KI = 0.00024205, KD = 0.19303, TF = 2.8731 
% Find Dz using Equation (8-65) 
disp('PIDF using Equation (8-65)') 
Dz_PIDF=KP+(KI*T) *tf£((1], [1 -1],T)+KD*tf([1 -1], [TF -TF+T],T); 
Dz PIDF = zpk(Dz PIDF) 

Dz PIDFGz = Dz PIDF*Gz; 

Cz PIDF = feedback(Dz PIDFGz,1) ; 

opt = stepDataOptions; opt.StepAmplitude = 80; 

step (Cz PIDF,1000,opt),gridsPlot PIDF Step Resp., Ref=80 mmHg 
disp('PIDF Gain and Phase Margin: ') 

[Gm, Pm] = margin(Dz PIDFGz); GmdB = 20*log10(Gm), Pm 

% disp('Unit-step performance metrics: ') 
PIDF_stepinfo=stepinfo(Cz_ PIDF) 


T= 5 

KP = 0.0185 

KI = 2.4205e-04 
KD = 0.1930 

TF = 2.8731 


PIDF using Equation (8-65) 
Dz PIDF = 
0.085672 (z-0.9208) (z-0.6895) 


GmdB: 9.1688 
Pm: 63.9993 
RiseTime: 40 


SettlingTime: 75 
SettlingMin: 0.9201 


SettlingMax: 1.0128 
Overshoot: 1.2805 
Undershoot: 0 
Peak: 1.0128 
PeakTime: 90 


Note the further improvement in performance at this new sampling interval. The settling time is 
reduced from 110 to 75 seconds. 

The time response of the system can also be improved by replacing the hood with a nasal 
cannula. Assume that this reduces the blender delay T, from 20 s to 10 s, while also reducing the 
hood time constant Ty from 55 seconds to 2 seconds. Under these new conditions, 


90e! 15/8" 
(+29 12s) $ + (7/12)8 + (1/24) 


G,(s) = (12-28) 
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If we select T = 2 s and model our blender delay as z >, the following MATLAB pro- 
gram generates a new design. Fig. 12-39 shows the pidtool results; Fig. 12-40, the step 
response. 


T = 2; t£((15/4],[1 7/12 1/24]); 
delay = tf([1],[1 0 0 0 0 0],T); 


without blender delay 
blender delay = z*(-5) 


2 
© 
o 

© 


Gpz = c2d(Gp,T); Gz=delay*Gpz 
disp(' ') 
disp('Now opening MATLAB pidtool GUI') 


disp('Set Pm = 64, wwl = 0.058') % Found by trial and error 
pidtool (Gz, 'pidf') 


Gz = 
5.202 z + 3.532 


z^7 - 1.214 2*6 + 0.3114 z^5 


Now opening MATLAB pidtool GUI 
Set Pm = 64, wwl = 0.058 


% Gains from MATLAB pidtool with Pm = 64, wwl = 0.058 

T, KP = 0.011288, KI = 0.00055493, KD = 0.020054, TF = 1.1507 

disp('PIDF using Equation (8-65)') % Find Dz using Eqn (8-65) 

Dz_PIDF=KP+ KI*T)*t£([1],[1 -1],T)+KD*tf£([1 -1], [TF -TF+T] ,T); 
Dz PIDF = zpk(Dz PIDF), Dz PIDFGz = Dz PIDF*Gz; 

Cz_PIDF = feedback (Dz PIDFGz,1) ; 

opt = stepDataOptions; opt.StepAmplitude = 80; 


8.0.0 PID Tuner 
aa aaO G@ D Design mode: | Exte... =] Form| Para.. +| Type| ... +) 
Plot: Step + Response: | Reference tracking s Show baseline Hide parameters 4a 
— = — p — > Controller parameters 
Tuned 
I Kp 0.011288 
| Ki 0.00055493 
1} berere Kd 0.020054 
| ao Tt 1.1507 
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§ 08} j Tuned 
| Rise time (seconds) 14 
od | | Settling time (seconds) 74 
| Overshoot 06) 5.77 
Fig { Peak 1,06 
| [——Tunearespense | Gain margin (rad/s) 7.24 @ 0.157 
0 at =n = r -T = Phase margin (rad/s) 64 @0.058 
s be 150 20 259 Closed-loop stability Stable 
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Interactive tuning 
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KI C) [0.058 rad/s 
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FIGURE 12-39 Screen shot of MATLAB pidtool (T = 2s). Source: Reprinted with permission from 
The MathWorks, Inc. 
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FIGURE 12-40 Step response for PIDF controller (T = 2 5). 


step(Cz_ PIDF,1000, opt),grid *Plot PIDF Step Resp., Ref=80mmHg 
disp('PIDF Gain and Phase Margin:') 
[Gm, Pm] = margin(Dz PIDFGz); GmdB = 20*log10(Gm), Pm 


% disp('Unit-step performance metrics:') 
PIDF_stepinfo=stepinfo(Cz_PIDF) 


T= 2 

KP = 0.0113 

KI = 5.5493e-04 
KD = 0.0201 

TF = 1.1507 


PIDF using Equation (8-65) 
Dz PIDF = 
0.028716 (z-0.8903) (z-0.3879) 


(z-1) (z+0.7381) 


GmdB : 7.2441 
Pm: 63.9994 
RiseTime: 14 
SettlingTime: 74 
SettlingMin: 0.9313 
SettlingMax: 1.0577 
Overshoot: 5.7672 
Undershoot: 0 

Peak: 057-7 
PeakTime: 34 


Note the further improvement in performance in rise time at this new sampling interval. 
The rise time is reduced from 40 seconds to 14 seconds, but at the expense of an increase in 
overshoot from 1.3% to 5.8% and a decrease in gain margin from 9.2 dB to 7.2 dB. The settling 
time is essentially the same. 
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This case study demonstrates that finding appropriate PID gains for a specific application 
can be quite challenging. However, the MATLAB pidtool makes gain parameter tuning less time 
consuming. 


12.6 TOPOLOGY IDENTIFICATION IN ELECTRIC 
POWER SYSTEM MODELS 


Let us consider a power system network consisting of n synchronous generators connected each 
other by a given topology. Let the internal voltage phasor of the i machine be denoted as E;Z8,. 
The electromechanical dynamics of the i generator, neglecting damping and the line resistance, 
can be written as: 


8; = 0; — Ws 
EE, 
Mò; = Pri — > ~ sin @; ~ òp (12-29) 
KEN, Xik 


where, w; (rad/s) is the angular velocity, P„; is the mechanical power input per unit, M; is the 
mechanical inertia, N; is the set of all nodes that are connected to the i machine, x;g is the reac- 
tance of the transmission line connecting machines i and k, ò; = ò; — òp, and w, = 1207 (rad/s) 
is the synchronous speed for the 60 Hz system. Linearizing (12-29) about an initial equilibrium 


(io, 120 T) for all i = 1, 2,...,m results in the small signal model: 
Aò 0 I)]f d8 0 
= + 12- 
[salle ollaol * Le a230) 
Aaa — 
A B 
Here, 
Aò = [Aù e AS] 
Aw =[Ao, -:: Ao, |" 


while I is the n-dimensional identity matrix, and M is a diagonal matrix of the machine iner- 
tias. e; is the j™ unit vector with all elements zero but the j element that is 1, considering that 
the input is modeled as a change in the mechanical power for the j machine. The input u is 
assumed to be an impulse at t = 0. The matrix L is the n X n Laplacian matrix whose elements 
are of the following form: 


EE; 
e If nodes i and j are connected, then Lj = —— cos (òjo) 
Xij 


° If nodes i and j are not connected, then L; = 0 


| cos (8,0) 


e For every row i, L; = — 5 
JEN, Xij 


where, N; is the set of indices for the generators that are directly connected to the i generator. 
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Next, assuming that the entire network consists of r coherent areas that are sparsely con- 
nected, and the i™ area consists of m; nodes, one can then rewrite (12-30) in a block form, where 
the (i, j)" off-diagonal block shows the connectivity between areas i and j. Its elements will be 
zero if two areas are not connected. Because of the clustered nature of the network, the off diago- 
nal blocks will be much sparser compared with the diagonal blocks. Moreover, L; is a large posi- 
tive number if nodes į and j are connected by a short tie-line with small reactance x;;. Similarly, 
L;j will be small positive number if nodes i and j are connected by a long transmission line with 
large reactance x,. As a result of this difference between the local and inter-cluster reactances, 
the eigenvalues of the matrix M!L will be divided into set of (r — 1) slow modes, while the 
remaining (n — r) modes will be characterized by fast eigenvalues representing the local oscil- 
lations inside areas. A standard assumption is that the (r — 1) slow modes can be attributed to r 
“equivalent” machines, which are connected to each other by an equivalent topology. Our objec- 
tive is to find the equivalent topology that connects these r equivalent machines using measure- 
ments of 8(¢) and w(t). Given these state measurements, our first task is to apply the subspace 
identification algorithms described in Section 11.4, identify the system matrix, compute its slow 
eigenvalues, and then extract the impulse response of these slow eigenvalues from the measured 
output. This “slow component” of the output can then be used for estimating the equivalent 
topology using a least squares algorithm, as described in Section 10.5. 

It is straightforward to see from the model (12-30) that the topology of the reduced-order 
system can be identified by estimating the parameters of the reduced-order model, i.e., equiva- 
lent machine inertias and the equivalent reactances of the transmission lines. To start, one can 
assume the equivalent topology to be a complete graph, meaning that every area is connected to 
every other area with equivalent tie-line admittance w,, the equivalent inertia of the iÈ area is 
M;, and then estimate the values of every w, and Mj, using the slow components of the available 
measurements. The identified values for w, will determine the topology of the reduced-order 
network. One can also set a threshold w, so that if Wij < WL; then Wij will be set to zero, i.e., 
areas i and j will not be connected. We next present a linear least squares approach to estimate 
the parameters w;; and MẸ, for all i and j. For simplicity of notations we denote the set of all the 
weights w; as w, and that for all the inertias Mj as M°. 

The discrete-time representation of the reduced-order model is written as 


x(k + 1) = A,(w, M®)x(k) + Byki) (12-31) 


where A, is a function of the unknown system parameters (w, M°), and determined from the 
continuous-time dynamics in (12-30) via a sampling period T. The k" time samples of the slow- 
mode dynamics are written as x(k) = [x,(k),... , x(k)]" fork = 0, ...,N. Thus, (12-31) can 
be rewritten as follows: 


Aa 
(x(k)? 0 0 uk) 0 0 z 
[x(k + 1] = : o, : bee eS - (12-32) 
——— 0 0 xb? 0 0 uel} ” 
Gps : 
N— AM Ban 
F; —— 


y 
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The least squares formulation will be complete by making the concatenation of G,’s and F; s by 
including all measurements as: 


min||Fy — G (12-33) 
y 2 
where F and G are formed as 
G, Fo 
G=]| -: |andF = : 
Gm En- 1 


This linear LS problem is convex and can be solved using CVX software [26]. CVX is a 
MATLAB-based modeling system for convex optimization. The drawback of this formulation, 
however, is that F is also dependent on the measurements that are usually perturbed by noise. For 
example, let us assume the perturbation in F and G are given by dF and dG, respectively. Then 
the upper-bound of deviation in estimation of y, denoted as dy is proportional to k°(F) where K 
is the condition number of F [27]. 

Next, we illustrate the LS-based identification using a case study of the IEEE 39-bus 
power system model. The model is shown in Fig. 12-41. 
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FIGURE 12-41 Power system model with 10 generators divided into 4 areas 
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It has 10 generators and 39 buses, which are divided into 5 areas as shown in the figure. 
We consider 2" order dynamics for all generators. We consider only five phase angle and fre- 
quency measurements at the buses marked with phasor measurement unit (PMU), meaning that 
a power system sensor known as PMU is installed at that bus. The disturbance of this system is 
modeled as a short-circuit that happens at £ = 1 s throught = 1.005 s at bus 29. All simulations 
are performed in MATLAB-based Power System Analysis Toolbox (PSAT). The results of iden- 


tification are shown as follows: 


e Exact equivalent system matrix: 


—7.9237 5.7529 
9.2245 —21.3526 
M'L = 2.0571 15.7177 


2.7404 12.2565 
8.5838 12.1187 


0.5 T T 
—— Actual measurements 
--- Linear LS estimation 
g 
È 
a 
3 
L 
3 
0.5 i L L L 
0 1 2 3 4 
Time (s) 


(a) 


0.3241 0.8105 
3.97 5.8124 
—38.7316 15.4481 
8.2278  —25.8022 
7.1880 6.3150 


1.0362 
2.3457 
5.5086 
2.5776 


—34.2054 


@ 1-03 (rad/s) 
7 


© 


—0.5 F 


— Actual measurements 


--- Linear LS estimation 


1-4 (rad/s) 


—0.5 k 


I I 
— Actual measurements 


=== Linear LS estimation 


Time (s) 


(c) 


FIGURE 12-42 Comparison of measured output with LS-identified output. 
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e Identified equivalent system matrix: 


—7.8459 4.9063 
9.1447 —17.0256 
M'L=| 00 21.2502 
0.6348 16.7347 
5.5511 23.5078 


0.0 1.1716 1.768 
0.0 7.8808 0.0 
—44.5462 19.0870 4.2085 
0.0 —20.3650 2.9911 
0.0005 9.50 —38.5591 


Fig. 12-42 compares the dynamics of the identified system using the LS algorithm with the 
actual slow component of the measured output. 
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Design Equations 


In this appendix, (8-33) is shown to be solutions to (8-31) and (8-32), by direct substitution. For 
convenience, D(jw,,,) will be written as D, and similarly, G(jw,,,) will be written as G. Then, 
from (8-29) and (8-33), 


1 — ao|G| cos 0 


day + 
_ ao F joya DA |G| sin 0 


1 + job cos8@ — apj|G 
J®w101 1+ Poer E, (A1-1) 
sin 0 
_ ao|G| sin@ + j(1 — ao|G| cos 0) 

|G|[sin® + j(cos 0 — a| G|)] 


Then 


a| G|’sin0 + 1 — 2ao|G|cos0 + ab|G|’cos 76 


oes 
ID| |G [sin’@ + cos’? — 2ay|G|cos @ + a>|G|?] 


(A1-2) 
aj|G/? + 1—2a)|G|cos@ 1 
|GP[a5|G|? + 1 — 2a9|G| cos6] = | G|? 


and (8-31) is satisfied. 
To show that the angle of D(jw,,;) is 0 let the numerator angle and the denominator angle 
in (A1-1) be denoted as 0, and 8, respectively. Then, from (A1-1), 


tan 8, — tan @, 
1 + tan @, tan 0, 


tan(®@,; — 8.) = 


1 —ay|G| cos®@ cos ® — ay|G| 
ay|G| sin 0 sin 6 (A1-3) 
cos 0 — ay|G| cos? — ay|G| + ai|G/* cos 0 


ay|G| sin’@ 


sin @[1 — 2ay|G| cos @ + aĝ| G|] 


= 1) ~ tand 
cos O[1 — 2ay|G| cos @ + a| G| 


using 
sin?@ — cos?@ = 1 — 2 cos’ 


Thus the angle of D(jw,,;) is 8, and (8-32) is satisfied. 


Mason's Gain Formula 


In this appendix we present a technique for finding the transfer function of a system, given either 
the signal flow graph or the block diagram of that system. 

By definition the transfer function of a continuous-time linear time-invariant (LTI) system 
is the ratio of the Laplace transform of the output variable to the Laplace transform of the input 
variable. Let E(s) be the Laplace transform of the input variable, C(s) be that of the output vari- 
able, and G(s) be the transfer function. One method of graphically denoting the relationship 


C(s) = G(s)E(s) (A2-1) 


is through a block diagram, as shown in Fig. A2-1(a). For the block shown, the output is equal 
by definition to the transfer function given in the block multiplied by the input. The input and the 
output are defined by the directions of the arrowheads, as shown. 

A signal flow graph is also used to denote graphically the transfer function relationship. 
The signal flow graph that represents (A2-1) is given in Fig. A2-1(b). Each signal is represented 
by a node in the signal flow graph, as shown by E(s) and C(s) in the figure. Each transfer func- 
tion is represented by a branch, shown in the figure by the line and arrowhead, with the notation 
for the respective transfer functions written near the arrowheads. By definition, the signal out of 
a branch is equal to the transfer function of the branch multiplied by the signal into the branch. 

Two very important points are to be made. First, a block diagram and a signal flow graph 
contain exactly the same information. There is no advantage to one over the other; there is only 
personal preference. Second, since a block diagram (or signal flow graph) is constructed from 
an equation or a set of equations, it is simply a graphical representation of those equations, that 
is, it does not contain any extra information beyond what is available from the system equations. 

One additional element is required to represent equations by a block diagram. This ele- 
ment is the summing junction, which is illustrated in Fig. A2-2 for the equation 


C(s) = Gi(s)E\(s) + Go(s)Eo(s) — G3(s)E3(s) (A2-2) 


For the block diagram, the summing junction is represented by a circle, as in Fig. A2-2(a). By 
definition, the signal out of the summing junction is equal to the sum of the signals into the junc- 
tion, with the sign of each component determined by the sign placed next to the arrowhead of 
the component. Note that whereas a summing junction can have any number of inputs, we show 
only one output here. 

For the signal flow graph, the function of the summing junction is inherently imple- 
mented by a node. A summing junction is represented by branches into a node, as illustrated 


E(s) | Gs) Cc s) Et) Ce) Ci (s) 


(a) (b) 
FIGURE A2-1 Block diagram and signal flow graph elements. 
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E\(s) E\(s) 
G(s) G(s) 


E4(s) + 4 C(s) Es) C(s) 
G(s) ai 


E3(s) E4(s) 
G;(s) 


y 


Y 


y 


—G,(s) 


(a) Block diagram (b) Signal flow graph 
FIGURE A2-2 Equivalent examples. 


in Fig. A2-2(b). By definition, the signal at a node is equal to the sum of the signals from the 
branches connected to that node. 

We now present a procedure that allows us to find the transfer function of either a block 
diagram or a signal flow graph simply by inspection. This procedure is called the Mason’s gain 
formula [1]. However, even though this procedure is relatively simple, it must be used with 
extreme care since terms in either the numerator or the denominator of the transfer function can 
easily be overlooked. Furthermore, there is no method available that will give an indication if 
any of these terms have been overlooked. However, Mason’s gain formula can be applied to 
simple systems with some confidence after one gains experience. 

In this section we give the rules for Mason’s gain formula as applied to signal flow graphs. 
Exactly the same rules apply to block diagrams. First, definitions are given as follows: 


Source node A source node is a node for which signals flow only away from the node; 
that is, for the branches connected to a source node, the arrowheads are all directed away 
from the node. 


Sink node A sink node is a node for which signals flow only towards the node. 


Path A path is a continuous connection of branches from one node to another with all 
arrowheads in the same direction; that is, all signals flow in the same direction from the 
first node to the second one, from the second to the third, and so on until it reaches the final 
node of that path. 


Loop A loop is a closed path (with all arrowheads in the same direction) in which no 
node is encountered more than once. Note that a source node cannot be a part of a loop, 
since each node in the loop must have at least one branch into the node and at least one 
branch out. 


Forward path A forward path is a path that connects a source node to a sink node, in 
which no node is encountered more than once. 


Path gain The path gain is the product of the transfer functions of all branches that form 
the path. 


Loop gain The loop gain is the product of the transfer functions of all branches that form 
the loop. 


Nontouching loops Two loops are nontouching if these loops have no nodes in common. 
A loop and a path are nontouching if they have no nodes in common. 
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FIGURE A2-3 Signal flow graph. 


All these definitions are illustrated using the signal flow graph of Fig. A2-3. There are two loops 
in the flow graph, one with a gain of —G, H; and the other with a gain of —G4H). Note that these 
two loops do not touch. In addition, there are two forward paths connecting the input R(s) and 
the output C(s). One of these forward paths has a gain of G; G, G; G4Gs, and the other has a gain 
of Gs G4 G5. Note that the forward path Gg G4 G; does not touch the loop —G,H, but does touch 
the other loop. The path G; G2 G; G4 G; touches both loops. 

Based on the preceding definitions, we may now state Mason’s gain formula. The formula 
gives the transfer function from a source (input) node to a sink (output) node only, and may be 
stated as 


1g 1 
T= DMA = MA + MA + + + M,A) (A2-3) 
k=1 


where T is the gain (transfer function) from the input node to the output node, p is the number of 
forward paths, and 


A = 1 — (sum of all individual loop gains) 
+ (sum of the products of the loop gains of all possible combinations of nontouching 
loops taken two at a time) 
— (sum of the products of the loop gains of all possible combinations of nontouching 
loops taken three at a time) 
+ (sum of the products of the loop gains of all possible combinations of nontouching 
loops taken four at a time) 
-(--) 
M= path sign of the kth forward path 
A; = value of A for that part of the flow graph not touching the kth forward path. 


An example is now given to illustrate the use of Mason’s gain formula. 


EXAMPLE A2-1 


Consider again the system of Fig. A2-3. Let L, be the gain of the ith loop. Then the gains of the 
only two loops can be written as 


Lı = —GH;; L, = —G,H, 
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Two forward paths are present in Fig. A2-3; the forward path gains can be expressed as 
Mı = G,G3G3G4G5; M, = G6G4Gs 
The value of A can be written directly from Fig. A2-3: 
A=1-(,+2L,)+ LL, = 1+ GH + GH, + GyG4H| A, 


The last term is present in this equation since the two loops do not touch; that is, the loops have 
no nodes in common. 

The determination of the A, of (A2-3) is more difficult. As just stated, the value of A, is 
the value of A for that part of the flow graph not touching the first forward path. One method 
of evaluating A, is to redraw the flow graph with the first forward path removed. Of course, all 
nodes of the first forward path must also be removed. Fig. A2-4(a) gives the results of removing 
the first forward path. The second part of the figure illustrates removing the second forward path. 
Hence A, is simply the A of the flow graph of Fig. A2-4(a), and A, is that of Fig. A2-4(b). Thus 
we can write 


A; = 1; A, = 1 — (~GH;) 


since Fig. A2-4(a) has no loops and Fig. A2-4(b) has one loop. Thus from (A2-3) we can write 
the transfer function of the system of Fig. A2-3 as 


= MA, + MA,  GıG2G3G4G5 + GeGyGs(1 + GH) 


A 1 + G-H, + G,H, + GG,H,H, 


Note that even for this relatively simple flow graph, many terms appear in the transfer func- 
tion. Hence terms can easily be overlooked. The only methods available to verify the results of 
Mason’s gain formula are algebraic methods such as Cramer’s rule [2]. 

As stated earlier, Mason’s gain formula can be applied directly to block diagrams. In the 
definitions which appear previously in this appendix, the following replacements are made, with 
the term signal defined as any input or any output of a block or a summing junction. 


FIGURE A2-4 Flow graphs with forward path removed. 
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Signal flow Block 
graph diagram 
input node > input signal 
output node > output signal 
branch => block 
node => signal 


Note that we can identify any internal signal as the output signal. 


References 
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Evaluation of E*(s) 


E*(s), as defined by (3-7), has limited usefulness in an analysis because it is expressed as an 
infinite series. However, for many useful time functions E*(s) can be expressed in closed form. 
This closed form of E*(s) will now be derived. 

From (3-6), 


e*(t) = e(r) (A3-1) 


However, this function is the inverse Laplace transform of E*(s) only for cases in which e(t) 
is continuous at all sampling instants. Problems arise if e(f) is discontinuous at any sampling 
instant, since the inverse Laplace transform evaluated at a discontinuity will give the average 
value of the discontinuity. As defined in Section 3.3, however, if e(t) is discontinuous at a sam- 
pling instant, then at that instant E*(s) assumes the value of e(t) from the right. For example, if 
e(t) is discontinuous at the origin, the calculation of E*(s) from (A3-1) would yield a value for 
the function at t = 0 of e(0)/2. Thus, if e(0) ~ 0, (A3-1) must be expressed as 


e*(t) = e(fd7(t) + e(O)S() (A3-2) 
If e(t) is discontinuous at other sampling instants, then impulse functions with values 
Ae(kT )8(t — kT) must be added to (A3-2), where Ae(kT) is the amplitude of the discontinuity 
of e(t) at t = kT; that is 
Ae(kT) = e(kT*) — e(kT) 
where e(kT ) = e(t) evaluated at t = kT — e£, and where e is arbitrarily small. 
The following derivation applies for the case in which e(t) is continuous at all sampling 
instants. From (A3-1), 


E*(s) = E(s)*Ar(s) (A3-3) 


where * denotes complex convolution [1] and A;(s) is the Laplace transform of 67(f). 
From (3-5), 


1 
Ans) =1L+te +e? 4+ o = = (A3-4) 
— el 
Therefore, the poles of A;(s) occur at values of s for which 
eT =] (A3-5) 
Equation (A3-5) is satisfied for s = j(2an/T) = jnw,,n = 0,1,2, --+ , where œw, is the 


sampling frequency expressed in radians per second. The poles of A;(s) are shown on the 
s-plane plot of Fig. A3-1. 
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4 jo 
Ss 
X J 20, 
K IMs 
X > 
oO 
X Js 
X 20, 
FIGURE A3-1 Poles of A;(s). 
By definition, equation (A3-3) can be expressed as 
1 acs 
E*(s) = — EQ)Ar(s — A)dd 
2] c—jo 
ae — e (A3-6) 
2Tj J ejo 1 — eN 


where the poles of the integrand of (A3-6) occur as shown in Fig. A3-2. The value of c must 
be chosen such that the poles of E(A) are to the left of the path of integration, and the value of s 
must be selected so that the poles of A;(s — N) are to the right of the path of integration [1]. An 
examination of (A3-6) and Fig. A3-2 indicates that E*(s) can be expressed as 


E*(s) = L PENA — Ad — -J EO)Ars — A)dÀ (A3-7) 
2Tj jy 2uj 


Consider the second integral of (A3-7). This term is zero if lim,_,..X\E(A) = O[i.e., if e(0) = 0]. 
If e(0) is not zero, the second integral can be shown to be equal to e(0)/2 following [2]. However, 


Evaluation of E“(s) 


Im(A) 4 


> 
Poles of Re(a) 
Ar(s-\) 


Poles of he 
EN) 


---*--X--*--X--X*--- 


FIGURE A3-2 Pole locations for the integrand of (A3-6). 
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from (A3-2), if e(0) is not zero, an additional term equal to e(0)/2 must be added to (A3-7). 
Therefore, in either case, 


E*(s) = Jp f EAr — N)dr (A3-8) 
2Tj jy 


The reader interested in a more detailed mathematical development of (A3-8) is referred to [1], 
[2], and [3]. 

The theorem of residues [3] can be used to evaluate (A3-8). We next state this theorem for 
a more pedagogical construction of (A3-8). 


Theorem of Residues. If C is a closed curve and if f(z) is analytic within and on C except 
at finite number of singular points in the interior of C, then 


$ foa = mjin tnt: +H] 
Cc 


where ri, h, ''* , r, are the residues of f(z) at the singular points within C. 


Using this theorem, we can express (A3-8) as 


(A3-9) 


1 
E*(s) = > residues i oma a) TGN 
— gT 


at poles 

of EA) 
Recall that the residues are evaluated at the poles of the function E(\), since as shown in Fig. A3-2, 
the singular points that lie within the closed contour are derived from this function. For the case 
in which E(s) has only simple poles, we may use (2-33). Or, by letting 


Ns) 


E(s) = A3-1 
(s) D(s) (A3-10) 
where M(s) and D(s) are polynomials in s, (A3-9) can be expressed as [4] 
Nay 1 
(An) (A3-11) 


E*(s) F > D'AN) 1 _ eg TS) 


where à, are the locations of simple poles of E(N) and 
dD) 
dN 


For multiple-ordered poles, the residue may be found using the expression illustrated in (2-34). 
It is of interest to consider the case in which the function e(t) contains a time delay. For 
example, consider a delayed signal of the type 


D'A) = 


elt) = e(t — b) u(t — t) (A3-12) 


Then 
E(s) = € ™ Lje ()] = €E (s) (A3-13) 


For this case, in general lim) _,,,. NE(A) is not finite in the second integral in (A3-7) (see Fig. A3-2), 
and thus (A3-9) does not apply. Special techniques are required to find the starred transform of a 
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delayed signal in closed form, and these techniques are presented in Chapter 4, where the modi- 
fied z-transform is developed. However, for the special case in which the time signal is delayed a 
whole number of sampling periods, (A3-9) can be applied in a slightly different form, 


1 
[e TE (ot =e > residues of EO) (A3-14) 


at poles eon 
of E,(\) 
where k is a positive integer. 
Equation (A3-6) can also be evaluated using the path a shown in Fig. A3-3. In this case, 
the poles of A;(s — N) are enclosed by a. For the case in which lim,_,..AE(A) is zero, the inte- 
gral around the infinite semicircular portion of a is zero and 


E*(s) = — > [residues of E(A)A7(s — N)] (A3-15) 
oles of 
RGN) 
This relationship is derived using the same steps that were used in the derivation of (A3-9). 
Recall that 


© 1 NO) 
Axs — à) = 1-86 DN 


(A3-16) 


has simple poles located at periodic intervals along a fixed line in the \-plane as shown in 
Fig. A3-3. Therefore, E*(s) can be expressed as 


= NA, 
E*(s) = po = ye) (A3-17) 
The poles of A;(s — N) occur at 
s-\, = A= = jrw, n = 0, +1, 2, ... (A3-18) 
Solving for N,, 
àn = 5S —jnwo, n= 0, +1, £2,... (A3-19) 


> 
Poles of 
EN) 


FIGURE A3-3 Integration path in the \-plane. 
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Now in this case 
D'N) = -Te Te ® (A3-20) 
Thus 
D'A) = -Te ?™" = -T (A3-21) 


Then using (A3-16) and (A3-21), (A3-17) can be expressed as 


E*(s) = >» E(s + jnw,) (A3-22) 


For the case in which lim,-...E(A) = 0, but e(0) # 0, the integral around the infinite semi- 
circular portion of a is also zero. However, because of the additional term in (A3-2), (A3-22) 
becomes 
ie e(0* 
E*(s) = T > E(s + jnw,) + T (A3-23) 


Therefore, the general expression for (A3-23) is 


oo 


E*(s) = 5 >) Els + jnw,) + >> Aen eo (A3-24) 


n=—0 


where Ae(nT) is the amplitude of the discontinuity of e(t) at t = nT. 
In summary, there are three expressions of E*(s). These are: 


o0 


E*(s) = YienNe*™ (A3-25) 
n=0 
E*(s) = > | residues of EQ) ae (A3-26) 
at poles € 
of EA) 
1 = . 1 Z —nTs 
E*(s) == 5 E(s + jnw,) + = > Ae(nT)e à (A3-27) 
Tn 210 
Equation (A3-25) is the defining equation for E*(s), and (A3-26) and (A3-27) are derived from 
(A3-25). 
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Review of Matrices 


Presented in this appendix is a brief review of matrices. Those readers interested in more depth 
are referred to [1] through [5]. 

The study of matrices originated from solving linear equations. As an example, consider 
the equations 


xX) + X2 + X3 = 3 
x} + X i X3 = (A4-1) 
2x 1 + X2 + 3x3 = 6 
In a vector-matrix format we write these equations as 
1 1 Ij% 3 
1 1-1jx%x]|=]1 (A4-2) 
2 1 3JL% 6 
We define the following: 
1 1 1 xX] 3 
A=]1 1 -1j x=/x%/, u=]1 (A4-3) 
2. J 3 X3 6 
Then (A4-2) may be expressed as 
Ax=u (A4-4) 


In this equation A is a3 X 3 (3 rows, 3 columns) matrix, xisa3 X 1 matrix, anduisa3 X 1 
matrix. Usually matrices that contain only one row or only one column are called vectors. A 
matrix of only one row and one column is a scalar. In (A4-1), x is a scalar. 

The general matrix A is written as 


ai 12 Ain 
_| %21 an ioe Mn | _ 
A= ` : . ` = [aj] (A4-5) 
ant Am2 ars Amn 


This matrix has m rows and n columns, and thus is an m X n matrix. The element aj, is the ele- 
ment common to the ith row and jth column. If m = n, the matrix is said to be square. 
Some special definitions are now given. 


Identity matrix. The identity matrix is an n X n (square) matrix with all main diagonal 
elements equal to 1 and all off-diagonal elements equal to zero. For example, the 3 X 3 
identity matrix is 
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1 0 0 
I=|0 1 0 (A4-6) 
0 0 1 
If Aisalson X n, 
AI=IA=A (A4-7) 


where the multiplication of matrices is defined below. 


Diagonal matrix. A diagonal matrix is an n X n matrix with all off-diagonal elements 
equal to zero. 


di 0 0 
D=|0 d 0 (A4-8) 
0 0 d} 


Symmetric matrix. The square matrix A is symmetric if aj = aj; for all i and j. 


Transpose of a matrix. To take the transpose of a matrix, interchange rows and columns. 
For example, 


111 he 2 
A=/]1 1-1], M=/]1 1 1 (A4-9) 
2 1 3 1-1 3 


where A’ denotes the transpose of A. A property of the transpose is 


(AB)! = B'AT (A4-10) 
Consider the partitioned matrix 
H = > d (A4-11) 


where D, E, F, and G are each n X n. Then H is 2n X 2n. The transpose of H is given as 
D F’ 
H’ = | | (A4-12) 


Trace. The trace of a matrix is equal to the sum of its diagonal elements. Given an 
n X n matrix A, 


trace of A = tr A = ayy + an + +++ + am (A4-13) 


Eigenvalues. The eigenvalues (characteristic values) of a square matrix A are the roots 
of the polynomial equation 


JAI — A] =0 (A4-14) 


where | + | denotes the determinant, and À is a scalar. 
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Eigenvectors. The eigenvectors (characteristic vectors) of a square matrix A are the vec- 
tors x; that satisfy the equation 


NX; = AX; (A4-15) 


where à; are the eigenvalues of A. 


Properties. Two properties of ann X n matrix A are 


la] = J]; (A4-16) 
i=1 

rA = Sr, (A4-17) 
i=1 


Given the partitioned 2n X 2n matrix 


D E 
H = i J (A4-18) 
where D, E, and G aren X n, and O is then X n null matrix. Then 
|H| = |D||G| (A4-19) 
With A and B square, 
|AB| = |A||B| (A4-20) 


Minor. The minor m, of element a,; of a square matrix A is the determinant of the array 
remaining when the ith row and jth column are deleted from A. For example, mz; for A of 
(A4-3) is 


1 1 


Cofactor. The cofactor c,; of element aj of the matrix A is given by 
cj = (- Dim; (A4-22) 
For (A4-21), 
Te cael a 2) ae (A4-23) 


Adjoint. The matrix of cofactors, when transposed, is called the adjoint of A (adj A). For 
A of (A4-3), 
Ci. Ga Gackt 4 -5 -1]F 
adjA = | co} cn C3] =] —-2 1 1 (A4-24) 
C31 C32 633 —2 


503 


504 


Appendix IV 


Inverse. The inverse of A is given by 


adjA 


Al= 
|A| 


(A4-25) 


where A`! denotes the inverse of A and |A | denotes the determinant of A. For A of (A4-3) 
and (A4-24) 


[A] = -2 
and 
=, 1 1 
A'=| 3 -3 -1 (A4-26) 
= 5 5 z 
L-i o 
Two properties of matrix inverses are 
AA! = A'A =I (A4-27) 
(AB)! = B'A! (A4-28) 


Note that the matrix inverse is defined only for a square matrix and exists only if the deter- 
minant of the matrix is nonzero. If A has an inverse, so does A !, with (A!) ! = A. For A 
square and |A| # 0, 


AD = (A)! = AT (A4-29) 


1 
|A! | = jal (A4-30) 


A useful determinant. Given the partitioned matrix 


D E 
H = F A (A4-31) 


where D, E, F, and G are each n X n. Then H is 2n X 2n. The determinant of H is given 
by [6] 


|H| = |G||D — EG F| = |D||G — FD”'E| (A4-32) 


provided that the indicated inverse matrices exist. 


The matrix inversion lemma. The matrix inversion lemma is [6] 


(A + BCD)! = A! — A'B(C! + DA'B) 'DA! (A4-33) 


provided that the indicated inverses exist. 
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ALGEBRA OF MATRICES 


The algebra of matrices must be defined such that the operations indicated in (A4-2), and any 
additional operation we may wish to perform, lead us back to (A4-1). 


Addition. To form the sum of matrices A and B, we add corresponding elements a; and 
b;,, for each i and j. For example, 


ij 
{.2 5 6 6 8 
f z] i iE | 7 pa A a 


Multiplication by a scalar. To multiply a matrix A by a scalar k, multiply each element 
of A by k. 


Multiplication of vectors. The multiplication of the 1 X n (row) vector with ann X 1 
(column) vector is defined as 


= xy, + xy E tee + On (A4-35) 
Yn 

Multiplication of matrices. An n X p matrix A may be multiplied by only a p X m 

matrix B; that is, the number of columns of A must equal the number of rows of B. Let 


AB=C 


Then the ijth element of C is equal to the multiplication (as vectors) of the ith row of A 
with the jth column of B. As an example, consider the product AA! from (A4-3) and 


(A4-26). 

1 1 ijf-2 1 1 

AA'=]1 1 -1]|f 3 =- -1 
2 1 3] $ SS, 0 

m (44-36) 
1 0 0 
=|0 1 oļ|=I 

0 0 1 


OTHER RELATIONSHIPS 
Other important matrix relationships will now be given. 


Differentiation. The derivative of a matrix is obtained by differentiating the matrix ele- 
ment by element. For example, let 


yi =] (A4-37) 


505 


506 


Appendix IV 


Then 
sah 
dx _ | dt 
cals paca 
dt 


(A4-38) 


Integration. The integral of a matrix is obtained by integrating the matrix element by 


element. In (A4-37), 


far = [Fe 


A property. Consider the scalar G: 


G = xly = y'x = xyi + xy + ++ + a 


Then, by definition, 


ag 
Ox] 
ðG . dG 
aG ‘ 
Xn 
Quadratic forms. The scalar 
F = x’Qx 


is called a quadratic form. For example, if x is second order, 


F = x'Qx = [x vf oe 


921 qril% 


m 2 2 
= qixt + (q2 + qaX1%2 + Go2x4 


Hence 
n n 
x'Qx = SD aie 
i=1j=1 


Note that Q can be assumed symmetric with no loss of generality. Now 


ar 
OF _ | Ox | _ | 2qux + Qin + Goer} _ 20x 
ox oF (G12 + Gai)x1 + 2Go2X2 


OX, 


(A4-39) 


(A4-40) 


(A4-41) 


(A4-42) 


(A4-43) 


(A4-44) 


(A4-45) 
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Bilinear forms. For two vectors x’ and y, the scalar 
G = x'Qy (A4-46) 
is called a bilinear form. For example, for x and y second order, 
G = x’Qy = [x wall alka 
921 = 22 IL y2 (A4-47) 
= Mit + 2X2 + qX + qaz 
Hence 
x'Qy = > Dara; (A4-48) 
i=1j=1 
Note that Q cannot be assumed symmetric. Then 
ðG 
dG ð. F 
ON 2 | SOME an ee = Qy (A4-49) 
ox dG Giyi + qyz 
OX 
and 
dG 
dG 0 + 
Oo _ | OM = ee = Qx (A4-50) 


One (oe 
Oy) 


qaxı + Go2X2 


Note that these relationships are directly evident from (A4-40) and (A4-41). For example, 
in (A4-40), replace y with Qy, and (A4-49) is obtained from (A4-41). 


Sign definiteness. 


If the scalar F = x’Qx > Oforallx # 0, the quadratic form is positive 


definite. If F = 0 for all x, the quadratic form is positive semidefinite. One test for sign definite- 
ness is given in Section 10.2. A second test is that the principal minors A;, i = 1,2, ---,n, 
are all positive (nonnegative) for F positive definite (positive semidefinite), where 


qi 
dı 


Ai S qi, A = 
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The Laplace Transform 


A brief review of the Laplace transform is presented in this appendix. We will see that the 
Laplace transform is useful in the modeling of a linear time-invariant analog system as a transfer 
function. The Laplace transform may also be used to solve for the free and forced responses of 
this type of system; however, these days one generally uses simulations, i.e., solutions to the sys- 
tem equations using computer programs for solving such responses, especially if the system size 
is large. For those readers who are interested in more details of the Laplace transform, [1] [2], 
and [3] are suggested for supplemental reading. 


INTRODUCTION 


By definition, the Laplace transform of a function of time f(t) is [1] 


F(s) = SIK] = | Koe "dt (A5-1) 
0 


where £ indicates the Laplace transform. Note that the variable time has been integrated out of 
the equation and that the Laplace transform is a function of the complex variable s. The inverse 
Laplace transform is given by 


o+jo 


KÀ = LIF] = a J F(sye"ds (A5-2) 


o— jo 


where £~! indicates the inverse transform and j = WoT 

Equations (A5-1) and (A5-2) form the Laplace transform pair. Given a function f(t), we 
integrate (A5-1) to find its Laplace transform F(s). Then if this function F(s) is used to evalu- 
ate (A5-2), the result will be the original value of f(t). The value of ø in (A5-2) is determined 
by the regions of convergence of (A5-1). We seldom use (A5-2) to evaluate an inverse Laplace 
transform; instead we use (A5-1) to construct a table of transforms for useful time functions. As 
an example, we will find the Laplace transform of the exponential function e “. From (A5-1), 


ig o —¢g star 00 
F(s) = fete “dt = | tdt = ——— 
0 0 sta 0 


= 5 Re(s + a) > 0 


(A5-3) 


where Re(-) indicates the real part of the expression. Appendix VI contains a rather extensive 
table of Laplace transforms and z-transforms, with the first two columns of this table giving 
Laplace transforms. The remaining column in this table is useful when we consider digital con- 
trol systems. 
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From the definition of the Laplace transform, (A5-1), 
PIKO] = KERO] = kF(s) (A5-4) 


for k constant, and 
PAO + AO] = LIAO] + LIAO] = Fls) + Fs) (A5-5) 


The use of these two relationships greatly extends the application of the Laplace-transform table 
of Appendix VI. 

We now present some examples of the Laplace transform and of the inverse Laplace trans- 
form. First, however, we need to note that using the complex inversion integral (A5-2) to evalu- 
ate the inverse Laplace transform results in f(t) = O for t < 0 [1]. Hence, to be consistent, we 
will always assign a value of zero to f(t) for all negative time. Also, to simplify notation, we 
define the unit step function u(x) to be 


u(x) = H a (A5-6) 


l, x20 


In Equation (A5-3), the Laplace transform of e” was derived. Note that the Laplace transform 


of e “u(t) is the same function. Thus for any function f(t), 


FIKO = POUD] = Fis) (A5-7) 
EXAMPLE A5.1 


The Laplace transform of the time function 
ft) = 5u(t) + 3e” 


will now be found. From Appendix VI and (A5-4), 


L£[5u(t)] = 5L[u@)] = 2 


S 


3 
LBE? = 3L] = —— 
pe ale s+2 


Then, from (A5-5), 


F(s) = L£[5u(t) + 3e ”] = 2 + : 5 
S 


This Laplace transform can also be expressed as 


PT LS S 
ae ede Same eo), 


The transforms are usually easier to manipulate in the combined form than in the sum-of-terms form. 
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This example illustrates an important point. As stated, we usually work with the Laplace trans- 
form expressed as a ratio of polynomials in the variable s (we call this ratio of polynomials a 
rational function). However, the tables used to find inverse transforms contain only low-order 
functions. Hence a method is required for converting from a general rational function to the 
forms that appear in the tables. This method is called the partial-fraction expansion method. 
A simple example is illustrated in the relationship 


C = kı + ky 
(stajst+b) sta stb 


Given the constants a, b, and c, the problem is to find the coefficients of the partial-fraction 
expansion k, and ky. We now derive the general relationships required. 
Consider the general rational function 


bys" + +++ + bys + bo _ Ns) 
” + ais! + +++ tas tay) DOY 


F(s) = m<n (A5-8) 


where Ms) is the numerator polynomial and D(s) is the denominator polynomial. To perform 
a partial-fraction expansion, first the roots of the denominator must be found. Then F(s) can be 
expressed as 
Ns Ns k k kn 

(Q - () _ k Si, os ae (A5-9) 
D(s) spi Spo S— Pn 
[IG = Pi) 


i=1 


F(s) = 


where Il indicates the product of terms. Suppose that we wish to calculate the coefficient k;. 
We first multiply (A5-9) by the term (s — pj). 


k\(s — pj) k,(s — Dj) 
genron y si ede See a 2 (A5-10) 
Ss Ppi S — Pn 


If this equation is evaluated for s = p;, we see then that all terms on the right side are zero except 


the jth term, and thus 
k=(s- P)F(s)| s=pp J = 1,2,...,n (A5-11) 
In mathematics, k; is called the residue of F(s) for the pole at s = pj. 


If the denominator polynomial of F(s) has repeated roots, F(s) can be expanded as in the 
example 


N(s) 
FCS Se TN 
(s — p(s — pr) 
(A5-12) 
k k k k 
= 1 + 21 + 22 3 Se aes he 2 
S— Pi S—Prx (s— po) (s — p) 


where it is seen that a denominator root of multiplicity r yields r terms in the partial-fraction 
expansion. The coefficients of the repeated-root terms are calculated from the equation 


Oo l dï 
Gaga? 


kaj [(s — PFC) | ,=p, (A5-13) 
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For the proof of the derivation of this equation please see [4]. 
The preceding development applies to complex poles as well as real poles. Consider the case that 
F(s) has a pair of complex poles. If we let pp = a — jb and p, = a + jb, (A5-9) can be written as 


ky ky k3 Ky 
— + — + ++ 
s-at+jb s—a-—jb sS-—p S— Dn 


F(s) = (A5-14) 


The coefficients kų and k, can be evaluated using (A5-11) as before. It will be found, however, 
that these coefficients are complex valued, and that k, is the conjugate of k,. In order to achieve 
a convenient form for the inverse transform, we will use the following approach. From (A5-11), 


ky = (s — a + jb)F(S)|,=a-p = Re” 
(A5-15) 
ky = (s mia — jb)F(s)| s=a+jp = Re = ki 


where the asterisk indicates the conjugate of the complex number. Define f(t) as the inverse 
transform of the first two terms of (A5-14). Hence 


fit) = Re® cP! + Reelt 


gi% # g7% 9) 
2Re“ > (A5-16) 


= 2Re“ cos(bt — 0) 


by Euler’s identity [2]. This approach expresses the inverse transform in a convenient form and 
the calculations are relatively simple. The damped sinusoid has an amplitude of 2R and a phase 
angle of 0, where R and 9 are defined in (A5-15). Three examples of finding the inverse Laplace 
transform are given next. 


EXAMPLE A5.2 


In this example the inverse Laplace transform of a rational function is found. 


5 5 
2 +3s+2 (s+ 1s +2) 


F(s) = 


First the partial-fractional expansion is derived: 


5 kı ky 


F(s) = = + 
(s + 1)(s + 2) stl s+2 


The coefficients in the partial-fraction expansion are calculated from (A5-11): 


5 

k = + DF = = -1 = 

1 (s ) (s)| s= 1 E zls= 1 5 
5 

ky = (s + 2)F(s)|s=-2 = l= = —5 


s+] 
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Thus the partial-fraction expansion is 
5 L A y S 
(s + 1)(s + 2) s+] s+2 


This expansion can be verified by recombining the terms on the right side to yield the left side of 
the equation. The inverse transform of F(s) is then 


LTF(s)] = (Se — 5e7)u(t) 


The function u(t) is often omitted, but we must then understand that the inverse transform can be 
nonzero only for positive time and must be zero for negative time. 


EXAMPLE A5.3 


As a second example of finding the inverse Laplace transform, consider the function 


2s + 3 2s + 3 ky kai Kao 
Fo) = 3 2 = Qi T 2 
gs +2s° + 8 s(s + 1) sS stl (s + 1) 


The coefficients kų and k», can easily be evaluated: 


k F( | 2s + 3 | 3 
— S S = rte s= — 
1 s=0 (s + 1? s=0 
2s + 3 
kn = (s + 1)°F(s)|,--1 = : ace -1 
We use (A5-13) to find k21: 
1 d d|2s+3 
ki = ———_((s + 1°F(8)] | ,=-1 = 
a = Go pigl + VFO = Al | = 
_ s(2) — (2s + 3)(1) 2 De, = 


s2 


s=—l 1 


Thus the partial-fraction expansion yields 


2s + 3 3 —3 =i 
F(s) = FF + 3 
s(s + 1) S stl] (s + 1) 


Then, from Appendix VI, ft) = 3 — 3e” — te”. 


EXAMPLE A5.4 


To illustrate the inverse transform of a function having complex poles, consider 


_ 10 _ 10 _ 10 
F(s) 3 2 2 2 2 
s + 45° + 95 + 10 (s + 2)(s* + 2s + 5) (s + Dis + 1) + 27] 
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* 


ky ky k2 
+ =t 7 
s+2 s+lil+hbh stl—-p 


* 


k k k 
1 4 2 + a 
s + pi S + py s+ po 


Evaluating the coefficient k, as before, 


10 10 
k, = (s + 2)F(s)|,--» = ie =—=2 
(s + 1) + 4|s=-2 5 
Coefficient k, is calculated from (A5-15). 
: 10 
ka = (s + 1 + j2)F(s) = : 

(s + 2)(s + 1 = j2))5=-1-)2 

10 10 


ELFDE- +1-7 -jE 
10 


= = 1.1182153.4° = RZ0 
(2.2362 (—63.4°)) (42(—90°)) 


Therefore, using (A5-16), 
ft) = 267 + 2.236e cos(2t — 153.4°) 


PROPERTIES OF THE LAPLACE TRANSFORM 


The Laplace transform was defined in the last section. For the analysis and design of control 
systems, however, we require several properties of the Laplace transform. As an example, we 
derive the final-value property. 

Suppose that we wish to calculate the final value of f(t), that is, lim f(. However, we 
wish to calculate this final value directly from the Laplace transform F(s) without finding the 
inverse Laplace transform. The final-value property allows us to do this. To derive this property, 
it is first necessary to find the Laplace transform of the derivative of a general function f(t). 


$| —| = [edt A5-17 
È o dt ( ) 
This expression can be integrated by parts, with 
af 
=g", dv= -dt 
ý "at 


Thus 


df i Fe 
“| =uv|o — [oa = {Oe ly = sfe “fdt 
F 0 


= 0 — KO) + sF(s) = sF(s) — f0) 


(A5-18) 
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To be mathematically correct, the initial-condition term should be f(0*) [1], where 
AO) = limf), 1 > 0 (A5-19) 


However, we will use the notation f(0). 
Now the final-value property can be derived. From (A5-17), 


d ” d 
iml e(2)] = lim / on 
s—0 dt 50 Jo dt 


(A5-20) 
= i F = li — fo 
a ha lim fit) — fO) 
Then, from (A5-18) and (A5-20), 
lim fit) — f(0) = lim [sF(s) — f(O)] (A5-21) 
or, 
lim, KÀ = lim sF(s) (A5-22) 


provided that the limit on the left side of this relationship exists. The right-side limit may exist 
without the existence of the left-side limit. 

Table A5.1 lists several useful properties of the Laplace transform. No further proofs of 
these properties are given here; interested readers should see [3, 4]. An example of the use of 
these properties is given next. 


TABLE A5-1 Laplace Transform Properties 


Name Theorem 
Derivative "d 
gL z| = sF(s) — f(0*) 
| dt 
nth-order derivative | d'f 
L| Sere as" FO) 
| dt 
eg ra ff? YO) 
Integral lf (s) 
gL | foar] = — 
L Jo s 
Shifting LL f(t — t) u(t — )] = € FCs) 
Initial value lim fi) = lim sF(s) 
> s>% 
Final value im fo = lim sF(s) 
Frequency shift LIERO] = F(s + a) 
Convolution integral f 


L'[F\(s)Fx(s)] = f Sit — Dfa)dr 
0 


= | Fit — 1)dt 
0 
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EXAMPLE A5.5 


As an example of applying the properties, consider the time function cos (af). 


S 
F(s) = SIO] = E t = =~ 
(s) O] [cosat] Oe 
Then, from Table AS.1, 
df . ka -a 
g[2] = £[-asinat] = sF(s) — K0) = Trg 1 = rarer 


which agrees with the transform from Appendix VI. Also, 


: _ sinat\ _ F(s) _ 1 
 [rmer) o = BP ae 


which also agrees with Appendix VI. The initial value of f(t) is 


S— 00 


, s? 
f0) = lim sF(s) = lim = ao =1 


which, of course, is correct. If we carelessly apply the final-value property, we obtain 


2 

S 
li t) = limsF(s) = li = 0 
lim f) = lim sP() tim | 5 ; =| 


which is incorrect, since cos (at) does not have a final value; the function continues to vary 
between | and —1 as time increases towards infinity. This exercise emphasizes the point that the 
final-value property does not apply to functions that have no final value. 


EXAMPLE A5.6 


As a second example, we consider the time function f(t) = 8?" 


Thus the function that we consider is 
Ai = fit — Aut — 4) = ult — 4) 


Both ff) and f,() are shown in Fig. A5.1. Note that f(t) is delayed by 4 s and that the value of 
the delayed function is zero for time less than 4 s (the amount of the delay). Both of these condi- 
tions are necessary in order to apply the shifting property of Table A5.1. From this property 


Lift — put = pH) =e F(s), F6) = LIAO] 


For this example, the unshifted function is e 9! and thus F (s) = 1/(s + 0.5). Hence 
—4s 


s+ 0.5 


, which is then delayed by 4 s. 


Le Put — 4)] = 


515 


516 
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f(t) 


1.0 
0.5 
0 2 4 6 8 t(s) 
AOA 
LO 
0.5 > 
L | L L | L | = 
0 2 4 6 8 t(s) 


FIGURE A5.1 Delayed time function. 


Note that for the case that the time function is delayed, the Laplace transform is not a ratio of 
polynomials in s but contains the exponential function. 


DIFFERENTIAL EQUATIONS AND TRANSFER FUNCTIONS 


In control system analysis and design, the Laplace transform is used to transform constant- 
coefficient linear differential equations into algebraic equations. Algebraic equations are much 
easier to manipulate and analyze than are differential equations. Whenever possible, we model 
analog physical systems with linear differential equations with constant coefficients. The Laplace 
transform, therefore, is a very helpful tool for simplifying the analysis and design of linear time- 
invariant systems. 

An example of a linear differential equation modeling a physical phenomenon is 
Newton’s law, 

PxA 


My = fo) (A5-23) 


where f(t) is the force applied to a mass M, with the resulting displacement x(t). It is assumed 
that the units in (A5-23) are consistent. Assume that we know the mass M and the applied force 
Jit). The Laplace transform of (A5-23) is, from Table A5-1, 


M{s?X(s) — sx(0) — x(0)] = F(s) (A5-24) 


where x(t) denotes the derivative of x(t). Thus to solve for the displacement of the mass, we must 
know the applied force, the initial displacement, x(0), and the initial velocity, x(0). Then we can 
solve this equation for X(s) and take the inverse Laplace transform to find the displacement x(t). 
We now solve for X(s): 


_ = n x(0) : x(0) 


X(s) s 2 


(A5-25) 
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For example, suppose that the applied force f(t) is zero. Then the inverse transform of (A5-25) is 
x(t) = x(0) + x(O)4, t20 (A5-26) 


If the initial velocity, x(0), is also zero, the mass will remain at its initial position x(0) for all 
time. If the initial velocity is not zero, the displacement of the mass will increase at a constant 
rate equal to that initial velocity. 

Note that if the initial conditions are all zero, (A5-25) becomes 


1 
X() = FGFs) (A5-27) 


Consider a physical phenomenon (system) that can be modeled by a linear differential equation 
with constant coefficients. The Laplace transform of the response (output) of this system can be 
expressed as the product of the Laplace transform of the forcing function (input) times a func- 
tion of s (provided all initial conditions are zero), which we refer to as the transfer function. We 
usually denote the transfer function by G(s). For the example given above we see from (A5-27) 
that the transfer function is 


1 
G(s) = Ms (A5-28) 


Another example is shown next. 
EXAMPLE A5.7 


Suppose that a system is modeled by the differential equation 


x(t) dx(t) a 
a + a + 2x(t) = AÀ 


In this equation, f(t) is the forcing function (the input) and x(t) is the response function (the out- 
put). If we take the Laplace transform of this equation, we have 


s°X(s) — sx(0) — x(0) + 3 [sX(s) — x(0)] + 2X(s) = 2F(s) 
Solving this equation for the response X(s), 


_ 2F(s) + (s + 3)x(0) + x(0) 


Xi 
(s) 2 +3s+2 


The transfer function is obtained by ignoring initial conditions. 
X(s) _ 2 
F(s) sv +3s+2 


G(s) = 


Suppose that we wish to find the response with no initial conditions and with the system input 
equal to a unit step function. Then F(s) = 1/s, and 


2 1 
X(s) = G(s)F(s) = =|] 
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or 


2 1 —2 1 
=—+ + 
s(s + 1)(s + 2) s st] s+2 


X(s) = 


by partial-fraction expansion. The inverse transform of this expression is then 
xt) = 1 — 2e” + e”, t=0 


Note that after a very long time, x(t) is approximately unity. The final-value property yields this 
same result: 


lim x(t) = lim sX(s) = lim-—————~ = 1 
Ha) = NO) = Ne + 3s 42 
In the last example, the response X(s) can be expressed as 
(s + 3)x(O) + x(0) 
X(s) = G(s)F(s) + = X/(s) + Xis) (A5-29) 


vr +3st+2 


The term X;(s) is the forced (also called the zero-state) response, and the term X;,(s) is the 
initial-condition (zero-input) response. This result is general. We see then that the total response 
is the sum of two terms. The forcing-function term is independent of the initial conditions, and 
the initial-condition term is independent of the forcing function. This characteristic is a property 
of linear equations, and is referred to as the superposition property. 

The concept of a transfer function is of fundamental importance to the study of linear feed- 
back control systems. To generalize the results of the preceding paragraphs, let a system having 
an output c(t) and an input r(t) be described by the nth-order differential equation 


d'c d''e dc 
TH. Qn-1l n1 +. + ay + age 
dt dt dt (A5-30) 
d” grl d 
= bp + bmi + tt bor 
dt” dt"! dt 


If we ignore all initial conditions, the Laplace transform of (A5-30) yields 


(st + Gast + +++ + ays + ag)C(s) (A5-31) 


= (bps + Dns" | + +++ + bis + bo)R(s) 


Ignoring the initial conditions allows us to solve for C(s)/R(s) as a rational function of s, namely, 


CCS) Dms” Dye” te eee + bis + bo 
R(s) s + aps! + +++ + as + ay 


(A5-32) 


Note that the denominator polynomial of (A5-32) is the coefficient of C(s) in (A5-31). The 
reader will recall from studying classical methods for solving linear differential equations that 


Appendix V 


this same polynomial set equal to zero is the characteristic equation of the differential equation 
(A5-30). 

Since most of the physical systems that we encountered were described by differential 
equations, we frequently referred to the characteristic equation of the system, or equivalently 
as the characteristic equation of the differential equation that described the system. The a; coef- 
ficients in (A5-30) are parameters of the physical system described by the differential equa- 
tion, such as mass, friction coefficient, spring constant, inductance, and resistance. It follows, 
therefore, that the characteristic equation does indeed characterize the system, since its roots are 
dependent only upon the system parameters; these roots determine that portion of the system’s 
response (solution) whose form does not depend upon the form of input r(t). This part of the 
solution is therefore the complementary solution of the differential equation. 
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Problems 


A5-1. Using the defining integral for the Laplace transform, (A5-1), derive the Laplace transform of 


(a) ft) = u(t — 2.5); (b) fl) = €“; (©) fl) = t. 
A5-2. (a) Use the Laplace-transform tables to find the transform of each function given. 
(b) Take the inverse transform of each F(s) in part (a) to verify the results. 


(i) fit) = 3e” (ii) fit) = —5 cos t 
(iii) fi) = 2e'- e” (iv) fit) = Te cos3t 
(v) fit) = 5cos (4t + 30°) (vi) A = 6e” sin (t — 45°) 


A5-3. (a) Find the inverse Laplace transform f(t) for each function given. 


(b) Verify the results in part (a) by taking the Laplace transform of each f(t), using the Laplace-transform 


tables. 
oO i 
MON eet ay Dee Mh = (er ser iy oD) 
Gi ne ae Ge 
GE gi. f $ + 5s+4 


A5-4. (a) Find the inverse Laplace transform f(t) for each function given. 


(b) Verify the results in part (a) by taking the Laplace transform of each f(t), using the Laplace-transform 


tables. 
: = 5 i 
OEE ay GD) FO = Fee D 
Gii) F(s) = a (iv) F(s) = _— 5730 
+245 i s(s" + 4s + 29) 
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A5-5. 


A5-6. 


Given the Laplace transform 


SES 


F(s) = = 
(9) s? + 4s + 13 


(a) Express the inverse transform as a sum of two complex exponential functions. 

(b) Using Euler’s relation, manipulate the result in part (a) into the form f(t) = Be sin (bt + ẹ). 
(c) Express the inverse transform as f(t) = Ae“ cos (bt + 8). 

(d) Take the Laplace transform of f(t) in part (c) to verify your result. 

(a) Plot f(A if its Laplace transform is given by 


F(s) = 


(b) The time function in part (a) is a rectangular pulse. Find the Laplace transform of the triangular 
pulse shown in Fig. PA5-6. 


FOA 


FIGURE PA5-6 Triangular pulse. 


A5-7. 


A5-8. 


A5-9, 


A5-10. 


Given that f(t) = 4e 2), 

(a) Find £[df(t)/dt] by differentiating f(t) and then using the Laplace-transform tables. 
(b) Find £[df(t)/dt] by finding F(s) and using the differentiation property. 

(c) Repeat parts (a) and (b) for KA) = 4e°" y(t — 3). 

The Laplace transform of a function f(t) is given by 


3s + 4 


F(s) = œ~ ~~~ 
(s) $ +3s+2 


(a) Without first solving for f(t), find aftr) /dt. 
(b) Without first solving for f(A), find L fodi. 


(c) Verify the results of parts (a) and (b) by first solving for f(t) and then performing the indicated 
operations. 

For the functions of Problem A5-4: 

(a) Which of the inverse transforms do not have final values; that is, for which of the inverse trans- 
forms do the lim,— aft) not exist? 

(b) Find the final values for those functions that have final values. 

(c) Find the inverse transform f(t) for each function in part (b) and verify your result. 

Given f,(t) = u(t) and (A = sin 10t. 

(a) Find £LAOILLAMI- 

(b) Find SAORA). 

(©) Is LLAMILIAC] equal to LIFO ? 


(d) Use the convolution integral of Table A5-1 to find the inverse transform of the results in part (a). 
(e) Verify the results of part (d) by finding £"![F,(s)F,(s)] directly. 


A5-11. 


A5-12. 


A5-13. 


A5-14. 


A5-15. 


A5-16. 


A5-17. 
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Given the differential equation 


PxA  dxÀ , 7 
Gp 5 g 4x(t) = 10u(t) 
(a) Find x(t) for the case that the initial conditions are zero. Show that your solution yields the 
correct initial conditions; that is, solve for x(0) and x(0) using your solution. 
(b) Show that your solution in part (a) satisfies the differential equation by direct substitution. 
(c) Find x(f) for the case that x(0) = 1 and x(0) = 1. Show that your solution yields the correct 
initial conditions; that is, solve for x(0) and x(0) using your solution. 
(d) Show that your solution in part (c) satisfies the differential equation by direct substitution. 
(e) Verify all partial-fraction expansions by computer. 
Given the differential equation 


Px) 20 
de T dt T XI 


(t) = 5, t=0 


(a) Find x(t) for the case that the initial conditions are zero. Show that your solution yields the 
correct initial conditions; that is, solve for x(0) and x(0) using your solution. 

(b) Show that your solution in part (a) satisfies the differential equation by direct substitution. 

(c) Find x(f) for the case that x(0) = 1 and x(0) = 2. Show that your solution yields the correct 
initial conditions; that is, solve for x(0) and x(0) using your solution. 

(d) Show that your solution in part (c) satisfies the differential equation by direct substitution. 

(e) Verify all partial-fraction expansions by computer. 

Find the transfer function C(s)/R(s) for each of the systems described by the given differential 

equation, where c(f) denotes the second derivative of c(t) with respect to t, and so on. 

(a) c(t) + 2c() = rA) 

(b) c(t) + 2c(t) = r(t — tult — to) + 3A) 

(c) C(t) + 3c) + 2c(t) + c(t) = rt) + 37) 

For each of the systems, find the system differential equation if the transfer function 

G(s) = C(s)/R(s) is given by 


60 3s + 20 
(G6) s? + 10s + 60 Ores) sy + 4s? + 8s + 20 
© Gs) = @ 69 = 3 
2 Je SS S55 a 

a s + 6s + 32 


(a) Write the characteristic equation for the system of Problem A5-11. 

(b) Write the characteristic equation for the system of Problem A5-12. 

(c) Write the characteristic equations for the systems of Problem A5-13. 

(d) Write the characteristic equations for the systems of Problem A5-14. 

Equations (A5-4) and (A5-5) illustrate the linear properties of the Laplace transform. This problem 

illustrates that these linear properties do not carry over to nonlinear operations. 

(a) Given f(t) = £”, find F(s) = SIAO] and Lif). 

(b) In part (a), is LROJ =F 7(s); that is, is the Laplace transform of a squared time function 
equal to the square of the Laplace transform of that function? 

(c) Given f,(t) = £™ and f(t) = £”, find F,(s), Fo(s), and EFO /A). 

(d) In part (c), is LAOA] = Fi(s)/F2(s); that is, is the Laplace transform of the quotient of 
two time functions equal to the quotient of the Laplace transforms of these functions? 

(a) Write the terms that appear in the natural response for a system described by the differential 
equation in Problem A5-11. 

(b) Write the terms that appear in the natural response for a system described by the differential 
equation in Problem A5-12. 

(c) Write the terms that appear in the natural response for a system described by the transfer func- 
tion in Problem A5-14(d). 
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Ackermann’s equation, 355 
Ackermann’s formula, 374 
for current observer, 370 
for gain matrix, 350 
adjoint of matrix, 503 
admissible control, 419 
admittance, 485 
aircraft lateral control system, 14 
aircraft lateral position, 13 
algebraic loop, 150 
algebraic Riccati equation, 437—438 
analog simulation of continuous 
systems, 60 
analog-to-digital (A/D) converter, 35, 
100, 134, 170 
antenna pointing system, 20-21 
antialiasing filter, 116 
a priori, 394, 407 
armature inductance, 19 
asymptotes, 245 
automatic aircraft landing system, 13, 
466-474 
chamber behavior for normal 
operating conditions, 467 
compensated-system Nyquist 
diagram, 471 
design, 468-471 
disturbances to be modeled, 470-471 
a-filter frequency response, 473-474 
F4J lateral frequency response, 469 
lateral control loop, 469 
lateral control system, 470-471 
Nyquist diagram, 468, 470 
plant model, 468 
o-B tracking filter, 471-472 
typical frequency response, 469 
autoregressive moving-average 
(ARMA) model, 402 
azimuth angle of antenna, 290 


bank command, 13 

mathematical relationships between 
wind input, 14 

basis functions, 391 

batch least squares, 409 

Bellman’s principle, 421, 433 

bilinear form, 507 

black-box identification, 394-401 

Bode diagrams, 258-259, 287 
summary of terms employed, 257 
breakaway points, 245-248 


C 


cascade compensation, 285 
Cauchy’s principle of argument, 249 


INDEX 


causal system, 109 
chamber temperature control hardware 
diagram, 462 
characteristic equation 
characteristic values of matrix, 74 
of a matrix, 74 
of the system, 519 
characteristic vector, 77, 79 
closed-loop digital control system, 170, 
173 
closed-loop discrete-time systems, 167 
closed-loop frequency response, 
261-270 
resonance in, 268 
closed-loop physical systems, 11 
mathematical solutions for, 16 
pilot’s concept of landing an aircraft, 11 
closed-loop system, 100 
characteristic polynomial, 346 
matrix, 350 
sampled-data, 169 
closed-loop transfer function T(z), 199, 
205 
CO) control system, 462-463 
cofactor of matrix, 503 
compensation on system, 285-287 
on digital control systems, 286 
integration and differentiation filters, 
307-309 
lag-lead, 303-307 
phase-lag, 287-294 
phase-lead, 294-295 
compensator, 11 
transfer function, 286-287 
complementary strip, 110-111 
complex power, 25 
complex variable theory, 56 
conditionally stable system, 289 
conservation of energy, 23 
constant damping loci, 209 
constant frequency loci, 209 
constant magnitude locus (constant M 
circle), 262-263 
constant N (phase) circles, 263-264 
constraint, 422 
continuous-time (analog) system, 219 
continuous-time signal, 133 
continuous-time state variables, 146-147 
model, 153 
for SMIB system, 26 
control actuator, 11 
control canonical form, 68 
state matrices for, 76 
control energy, 419 
controllability, concepts of, 374-378 
controller, 11 
controlling unit, 13 


control problem, 15-16 
control software packages, 223 
control system designer, task of, 15 
control system specifications 
constraints on control effort, 285 
disturbance rejection, 284-285 
relative stability measurements, 
282-283 
sensitivity of system characteristics, 
283-284 
steady-state accuracy, 280 
transient response, 280-282 
convex function, 486 
convolution. See discrete convolution 
costate, 433-434 
cost function, 418, 429 
terms in, 422 
Cramer’s rule, 172, 176 
critically damped, 324, 328-332 
crossover point, 247, 268 
current estimator, 442 
current observers, 369—374 
current phasor, expression for, 25 


D 
damping factor for linear friction, 147 
data hold, 102 
data reconstruction, 113—121 
first-order hold, 118-119 
fractional-order hold, 119-121 
reconstructed version of e(t), 113 
using polynomial extrapolation, 113 
zero-order hold, 114—118 
data-reconstruction device, 101 
DC gain, 131, 203 
dc motor system, 18 
decimal-to-binary conversion 
algorithms, 293 
delayed z-transform, 136-137 
derivation procedure, 171-172 
derivative of a matrix, 505-506 
diagonal matrix, 502 
differentiator transfer function, 309 
digital computer, 35-36 
digital controllers, 12 
with nonzero computation time, 141 
nth-order linear, 140 
digital control system, 12-15 
digital filter, 37 
differentiation of a function, 308 
in U.S. Navy aircraft carriers, 37 
digital-to-analog (D/A) converter, 35, 
100, 134 
discrete convolution technique, 57-58 
discrete Riccati equation, 434, 439-440 
discrete state equations of a sampled- 
data system, 150-154 
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discrete state matrices, 180-181 
discrete state models for digital control 
systems, 183—188 
discrete state-space model for the closed 
loop, 187 
discrete-time systems, 12, 35-37 
with time delays, 139-142 
discrete unit impulse function, 43, 256 
discrete unit step function, 41 
disturbances, 13 
double-sided z-transform, 38 
dynamic systems, identifying, 394 
batch least squares, 409 
black-box identification, 394—401 
choice of input, 412-413 
least-squares system identification, 
401-407 
practical factors for identification, 
412-414 
recursive least-squares system 
identification, 409-412 
sampling frequency, 413 
signal scaling, 413-414 


E 
eigenvalues, 74, 435-438, 502 
eigenvectors, 435—438, 503 
electric circuit law, 25 
electric power, 26 
electric power system, 484 
electric power system models, topology 
identification in, 484-488 
environmental chamber control system, 
461-466 
error-control condition, 382 
error signal, 15, 18, 21 
E*(s), 169, 208 
amplitude of the discontinuity of 
e(t), 500 
for e(t) = € ', 105 
for e(t) = u(t), 104-105 
evaluation of, 105—108, 496-500 
Laplace transform of, 105 
properties of, 110-113 
relationship between E(z) and, 
126-127 
theorem of residues, 498-499 
zeros of, 110 
Euler method, 219 
Euler’s identity, 511 
Euler’s relation, 54, 107, 110 


F 


feedback, parallel, or minor-loop 
compensation, 286 

feedback path, 103 

filter transfer function, 298, 302, 310 

final-value theorem, 204, 470, 515 

first-order hold, 118-119 

frequency response of, 119-120 

first-order linear differential equation, 
23, 36 

flow graphs, 59-62 


forward path, 492 
Fourier transform 
of e(t), 111, 115 
results from, 108-110 
fractional-order hold, 119-121 
frequency response magnitudes for, 
121 
impulse response of, 120 
transfer function of, 119 
frequency aliasing, 116 
frequency foldover, 116 
frequency response, interpretation of, 
110, 259-261 
frequency spectrum of e(t), 109 
full-order current observer, 369—370 
fundamental matrix, 85 


G 


gain margin, 255 

general rational function, 510 
generating function, defined, 38 
grey-box identification, 391 
G(z), 198 


H 

Hankel matrix, 396, 399-400 

hardware configuration of system, 349 

high frequency gain, 287 

high-order systems, computations for, 
154-155 


l 
ideal filter, 112 
ideal sampler, 102-104 
defined, 104 
ideal time delays, systems with, 
139-142 
identity matrix, 501 
TEFE 39-bus power system, 486, 487 
impulse functions, 134 
impulse modulator, 103 
inertia, 485 
infinite bus, 24 
infinite-horizon linear-quadratic- 
Gaussian (IH-LQG) design, 442, 
444—446 
initial-condition (zero-input) response, 
518 
input space of system, 63 
integral of a matrix, 506 
integrator transfer function, 308 
inverse Laplace transform, 103, 149 
inverse z-transform, 200, 206-207 
discrete convolution technique, 57-58 
inversion-formula method, 56 
partial-fraction expansion method, 52 
power series method, 51 
inversion-formula method, 56 


K 

Kalman filters, 374, 440-444 
Kirchoff’s law, 25 

Kronecker delta function, 440 


L 
Laplace transform, 17, 24, 37, 52, 57, 
102-103, 508-519 
of constant-coefficient linear 
differential equations into 
algebraic equations, 516-519 
convolution property of, 133 
definition of, 508 
of exponential function, 508 
inverse, 508, 511-513 
of linear time-invariant continuous- 
time systems, 37-38 
properties, 513-514 
for system response, 218 
transfer function, 169 
lateral control system, 13 
least squares estimation, 392, 401, 486 
least-squares minimization, 446 
least-squares system identification, 
401-407 
linear quadratic (LQ) optimal control, 
424-428 
linear time-invariant difference 
equations, solving, 48-51, 59 
linear time-invariant (LTT discrete-time 
systems, 12 
bilinear transformation, 234—238 
characteristic equation of, 234 
Jury stability test, 239-243, 245-246 
Nyquist criterion for, 248-256 
root locus for, 244—247 
Routh—Hurwitz criterion, 236-241, 
246 
stability, 230-233 
linear time-invariant (LTD systems, 
167, 391 
linear time-varying discrete system, 
89-90 
loop, 492 
loop gain, 492 
low-order single-input single-output 
systems, 378-380 


M 


marginally stable, 231 
Marine Air Traffic Control and Landing 
System (MATCALS), 466, 468 
Mason’s gain formula, 61—62, 68, 
80, 150, 172, 174, 176-177, 
491-493 
MATLAB pidtool, 319-321, 477-484 
MATLAB sisotool, 332-333 
matrix, 18, 501-507 
adjoint of, 503 
algebra of, 505-507 
cofactor of, 503 
derivative of a, 505-506 
determinant of, 504 
diagonal, 502 
identity, 501 
inverse of, 504 
inversion lemma, 504 


minor of, 503 
multiplication of a, 502, 505 
partitioned, 502 
symmetric, 502 
trace of a, 502 
transpose of, 502 
McDonnell-Douglas Corporation F4 
aircraft, 14 
mechanical power, 26 
memory locations (shift registers), 60 
minimum-cost function, 424 
minimum principle, 433-434 
modal matrix, 77-78 
modified z-transform, 136-139, 499 
properties of, 137 
Moore-Penrose pseudo-inverse of ®, 
392 
motor back emf, 18 
multiplication of matrices, 505 
multiplication of scalars, 505 
multiplication of vectors, 505 


N 


neonatal fractional inspired oxygen, PID 
feedback controllers for 
MATLAB pidtool PIDF controllers, 
477-484 
plant transfer function, 474-476 
Taube’s PID controller, 476-477 
Newton’s laws, 390, 516 
second law of motion, 25 
Nichols chart, 264—266 
ninth-order ordinary nonlinear 
differential equation, 14-15 
nonsynchronous sampling, 142-145 
nontouching loops, 492 
nth-order continuous-time system, 37 
nth-order differential equation, 518 
nth-order linear difference equation, 37 
nth-order linear digital controller, 140 
numerical integration algorithm, 
219-222 
Nyquist criterion for discrete-time 
systems, 248-256, 311 
characteristic equation, 249 
frequency response for G(z), 253 
gain and phase margins, 255 
MATLAB program to plot Nyquist 
diagram, 254-255 
Nyquist diagram, 250-251 
Nyquist path, 249-250 
pulse transfer functions, 255-256 
s-plane Nyquist diagram, 249-250 
theorem, 249 
transfer function, 248 
z-plane Nyquist diagram, 251-252 


(0) 


observability, concepts of, 374—378 

observer-based control systems, 
369-374 

observer canonical form, 68 

open-loop de gain, 203 


open-loop sampled-data systems, 168 

open-loop systems containing digital 
filters, 133-134 

model, 134 

open-loop transfer function, 234 

optimal control law for system, 428—429 

optimality, principle of, 421-424 

original signal flow graph, 171, 173-174, 
176-177 

output-feedback controller, 26 

overshoot, 206 


P 


parameter Estimation, 391 
partial-fraction expansion method, 52, 
510, 512 
path, 492 
path gain, 492 
peak overshoot, 280-282 
percent peak overshoot, 26 
performance index, 418 
persistency of excitation, 412 
phase-lag compensator, 287—294 
advantages, 303 
phase-lead compensation, 294-295 
advantages of, 303 
closed-loop frequency responses, 
299, 301 
design procedure, 295-298 
disadvantages of, 303 
MATLAB program, 291-292, 299 
open-loop frequency responses, 
299-300, 302-303 
step responses, 300 
phase-lead filter, 299 
phase margin, 255 
phase margin of the compensated 
system, 289 
phase variable canonical form, 68 
physical sampler, 103 
pitch angle, 21 
plant 
defined, 11 
dynamics of, 12 
pole assignment/pole placement, 
343-346 
pole—zero cancellations, 391 
pole-zero locations, 110 
positive definite quadratic form, 507 
positive semidefinite quadratic form, 
507 
power amplifier, 101 
power series method, 51 
prediction errors, covariance of, 442 
prediction observer, 353 
predictor-corrector algorithm, 221-222 
primary strip, 110-111 
proportional-integral (PI) compensator, 
35 
proportional-plus-derivative (PD) 
controller, 247 
proportional-plus-integral (PI) 
compensator, 243 
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proportional-plus-integral-plus- 
derivative (PID) controller, 37, 
279, 309-313, 463 
analog version of, 463 
block diagram, 464 
design process, 313-315 
frequency response for, 310-311 
MATLAB program, 316-318 
step response behavior, 464—465 
transfer function, 309-310, 312 
pseudo inverse, 392. See also, Moore 
Penrose pseudo inverse 
pulse transfer function, 127—133 


quadratic cost function, 419-421 
quadratic form, 419, 506 


R 


radar-noise disturbances, 14 
radar unit, 13 
rectangular rule for numerical 
integration, 36, 219 
recursive least-squares system 
identification, 409-412 
reduced-order observer, 364-369 
regulator control system, 378 
repeated-root terms, 510 
residue of a function, 106 
residue of F(s), 510 
resonance, 267-268 
response, defined, 15 
resultant system stability margins, 293 
Riccati equation, 434, 437 
rise time, 280-282 
robotic control system, 21-22 
root locus for a system, 321-334 
characteristic equation, 321-322 
filter dc gain equal unity, 322 
MATLAB program for, 324-326, 
330-333 
phase-lag design, 322-324 
phase-lead design, 326-328 
round-off errors in computer, 220 
Runge-Kutta rule, 223 


S 
sampled-data control systems, 100-103, 
113 
sampled signal flow graph, 172 
sample period, 13 
sampler-data hold device, 101—103 
satellite model, 16-18 
second-order differential equation, 17 
second-order system, 441 
second-order transfer function, 17 
series compensation, 285 
sensitivity, 283 
servomechanism, 20-21 
servomotor system, 18-22, 429, 
454461 
computer data format, 456 
phase-lag filter, 460-461 
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servomotor system (continued ) 
phase lead design, 459-461 
system frequency response, 458—460 
system hardware, 455 
system model, 456-459 
settling time, 280-282 
Shannon’s sampling theorem, 112-113 
shifting theorem, 138 
signal flow graph, 60 
corresponding state equations of, 68-69 
similarity transformations, 73 
properties, 74 
simulation diagrams 
of analog plant, 154 
for discrete-time systems, 59-62 
single-machine infinite bus (SMIB) 
power system, 24—26 
continuous-time state-variable model 
for, 26 
current phasor, expression for, 25 
set of symbols, 25 
single-sided z-transform, 38 
single-valued function relationship, 64 
singular value decomposition (SVD), 
396 
sink node, 492 
SNR (signal to noise ratio), 413 
source node, 492 
specific heat of liquid, 23 
stabilizable, 439 
starred transform, 102, 111 
state equations 
numerical method via digital 
computer, 87 
recursive solution, 84—86 
z-transform of, 81-84, 86-87 
state estimator 
closed-loop state equations, 363-364 
closed-loop system characteristic 
equation, 362-363 
controller transfer function, 359-362 
error dynamics, 354-356 
errors in, 354 
example, 356-359 
observer model, 352-353 
plant—observer system, 355 
state transition matrix, 85, 149 
computer method for finding, 87 
properties of, 88 
state-variable formulations, 71 
converting continuous state 
equations, 178-183 
for diagonal elements, 76-78 
for digital controller, 183-188 
examples, 71-80 
for mechanical system, 147—150 
of open-loop sampled-data systems, 
145-146 
using linear-transformation matrix, 
75-76 
using partial-fraction expansion, 
72-73 
using similarity transformations, 
73-74 


state-variable model of a system, 63—64 
example, 64-68 
multivariable discrete system, state 
equations for, 70-71 
transfer function, state equations for, 
69-70 
static systems, 391-393 
steady-state accuracy, 215-218 
steady-state optimal control, 434-438 
stiffness factor, 147 
summing junction, 491 
symmetric matrix, 502 
synchronous generator, 484 
system characteristic equation, 207—208 
system identification, 390 
system time response, 198-200 
for all instants of time of sampled- 
data system, 201 
analog system unit-step response, 200 
effects of sampling, 200-202 
mapping s-plane into z-plane, 
208-215 
simulation of, 218—222 


T 
Taube’s PID controller, 476—477 
temperature control system, 22-24, 
463-466 
Texas Instruments TI9900 
microprocessor system, 455 
thermal capacity of liquid, 23 
thermal system. see temperature control 
system 
three-axis control of satellite, 16-18 
thrusters, 16 
time-delayed function, 41 
time-invariant analog filter, 37 
time-invariant system, 12 
time to peak overshoot, 280 
TMS 9900 microcomputer system, 462 
topology, 484, 485 
trace of a matrix, 502 
tracking error e(t), 100 
transfer function, 59-61, 80, 168, 170, 
293, 407, 517 
closed-loop, 205 
of continuous-time system, 204 
controller, 359-362 
controller-estimator, 371 
of controller estimator, 373—374 
differentiator, 309 
of a digital PID controller, 309-310, 
312 
discrete-time, 400 
filter, 302, 310 
of a first-order hold, 118 
of fractional-order hold, 119 
integrator, 308 
partial-fraction expansion of, 72-73 
poles or zeros of, 407 
for a pure delay of T seconds, 68 
for sampled-data systems, 171 
set of discrete state-variable equations 
from, 65-66 


state equations, 69—70 

of zero-order hold, 115 

zeros of system, 379-380 
transform methods, 37-38 
transient response, 207 
transmission line, 24—25 
transpose of a matrix, 502 
trapezoidal rule for numerical 

integration, 221-223, 307 


U 


uncontrollable, 375 

unilateral Laplace transform, 109 

unit circle, 231 

unit sample function, 43 

unit-step function, 102, 509 

unit-step response of the sampled-data 
system, 202-203 

unity-dc-gain phase-lead compensator, 
298 

U.S. Navy aircraft carriers, 12 


V 


vector-matrix form, 18, 501-507 
voltage equation for armature 
circuit, 19 


W 


weighting matrix, 419 
wind-noise disturbances, 14 


Y 


yaw-axis control systems, 16, 20-21 


Z 
zero-order hold, 102, 119, 134, 152, 
169, 178, 180-181, 202-203, 
223 
frequency response of, 116 
input and output signals for, 114 
transfer function of, 115 
zero-order-hold transfer function, 
defined, 104 
z-transform, 38, 203, 234, 247, 308, 379 
of delayed time function, 136 
double-sided, 38 
examples, 38—40 
finding, 45—46 
generated using MATLAB, 46 
modified, 136-139 
region of existence in complex plane, 
40 
single-sided, 38 
of state equations, 81-84 
transfer function, 145 
transform, properties of, 45 
addition and subtraction, 40 
complex translation, 43 
of e(k), 41 
final-value property, 44, 135 
initial-value property, 44 
inversion integral, 41 
multiplication by a constant, 40-41 
real translation, 41—42 
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